[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:50:11 dist-test-slave-bndk krb5kdc[29534](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:50:11 dist-test-slave-bndk krb5kdc[29534](info): set up 2 sockets
Aug 08 17:50:11 dist-test-slave-bndk krb5kdc[29534](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 17:50:12.323854 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:50:12 dist-test-slave-bndk krb5kdc[29534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:50:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:50:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:50:12.436235 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:43677
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:36295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:43677
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:12.517310 29553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:12.517493 29553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:12.517513 29553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:12.518574 29553 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:12.518607 29553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:12.518620 29553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:12.518630 29553 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:12.518646 29553 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:50:12.520131 29553 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:36295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:43677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:43677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:12.520314 29553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:12.520488 29553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:12.524936 29560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:12.524945 29563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:12.524976 29561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:12.525048 29553 server_base.cc:1034] running on GCE node
I20260808 17:50:12.525390 29553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:12.525674 29553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:12.526813 29553 hybrid_clock.cc:648] HybridClock initialized: now 1786211412526758 us; error 71 us; skew 500 ppm
Aug 08 17:50:12 dist-test-slave-bndk krb5kdc[29534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211412, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:12.529142 29553 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:50:12.529579 29553 webserver.cc:460] Webserver started at http://127.28.213.190:42269/ using document root <none> and password file <none>
I20260808 17:50:12.529784 29553 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:12.529832 29553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:12.529958 29553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:12.530972 29553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "41db61ecce6d4cb39732d7e61edb46b0"
format_stamp: "Formatted at 2026-08-08 17:50:12 on dist-test-slave-bndk"
server_key: "3c1bb223c56f1edf264b9f4507b288f2"
server_key_iv: "860675d0eed078107639f261e371d190"
server_key_version: "encryptionkey@0"
I20260808 17:50:12.531311 29553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "41db61ecce6d4cb39732d7e61edb46b0"
format_stamp: "Formatted at 2026-08-08 17:50:12 on dist-test-slave-bndk"
server_key: "3c1bb223c56f1edf264b9f4507b288f2"
server_key_iv: "860675d0eed078107639f261e371d190"
server_key_version: "encryptionkey@0"
I20260808 17:50:12.532487 29553 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:50:12.533114 29570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:12.533280 29553 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:12.533375 29553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "41db61ecce6d4cb39732d7e61edb46b0"
format_stamp: "Formatted at 2026-08-08 17:50:12 on dist-test-slave-bndk"
server_key: "3c1bb223c56f1edf264b9f4507b288f2"
server_key_iv: "860675d0eed078107639f261e371d190"
server_key_version: "encryptionkey@0"
I20260808 17:50:12.533452 29553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:12.550864 29553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:12.552764 29553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:12.552894 29553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:12.556669 29553 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:43677
I20260808 17:50:12.556702 29651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:43677 every 8 connection(s)
I20260808 17:50:12.556993 29553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:50:12.557811 29652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:12.560025 29652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0: Bootstrap starting.
I20260808 17:50:12.560603 29652 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:12.560856 29652 log.cc:824] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:12.561336 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 29553
I20260808 17:50:12.561431 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:50:12.561560 29652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0: No bootstrap required, opened a new log
I20260808 17:50:12.562047 29526 external_mini_cluster.cc:1428] Setting key 16319809ef4534f50c61b56f2d98a2d8
I20260808 17:50:12.563308 29652 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41db61ecce6d4cb39732d7e61edb46b0" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 43677 } }
I20260808 17:50:12.563438 29652 raft_consensus.cc:374] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:12.563460 29652 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41db61ecce6d4cb39732d7e61edb46b0, State: Initialized, Role: FOLLOWER
I20260808 17:50:12.563565 29652 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41db61ecce6d4cb39732d7e61edb46b0" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 43677 } }
I20260808 17:50:12.563635 29652 raft_consensus.cc:388] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:50:12.563658 29652 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:50:12.563704 29652 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:12.564553 29652 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41db61ecce6d4cb39732d7e61edb46b0" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 43677 } }
I20260808 17:50:12.564642 29652 leader_election.cc:302] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 41db61ecce6d4cb39732d7e61edb46b0; no voters:
I20260808 17:50:12.564790 29652 leader_election.cc:288] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:50:12.564832 29658 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:12.564990 29658 raft_consensus.cc:686] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0 [term 1 LEADER]: Becoming Leader. State: Replica: 41db61ecce6d4cb39732d7e61edb46b0, State: Running, Role: LEADER
I20260808 17:50:12.565070 29652 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:12.565116 29658 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41db61ecce6d4cb39732d7e61edb46b0" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 43677 } }
I20260808 17:50:12.565557 29660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41db61ecce6d4cb39732d7e61edb46b0. Latest consensus state: current_term: 1 leader_uuid: "41db61ecce6d4cb39732d7e61edb46b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41db61ecce6d4cb39732d7e61edb46b0" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 43677 } } }
I20260808 17:50:12.565647 29660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:12.565874 29659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "41db61ecce6d4cb39732d7e61edb46b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41db61ecce6d4cb39732d7e61edb46b0" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 43677 } } }
I20260808 17:50:12.565950 29659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:12.566128 29675 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:50:12.566713 29675 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:50:12.568334 29675 catalog_manager.cc:1347] Generated new cluster ID: 93055251663f4c738abefe62974c777a
I20260808 17:50:12.568385 29675 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:50:12 dist-test-slave-bndk krb5kdc[29534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:12.578356 29655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:12.562801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56552 (local address 127.28.213.190:43677)
0808 17:50:12.562981 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:12.562990 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:12.563194 (+ 204us) server_negotiation.cc:407] Connection header received
0808 17:50:12.564926 (+ 1732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:12.564934 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:12.564989 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:12.566268 (+ 1279us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:12.567232 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:12.568384 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:12.569813 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:12.570444 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:12.570559 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:12.574533 (+ 3974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:12.574537 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:12.574537 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:12.574548 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:12.576343 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:12.576877 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:12.576880 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:12.576880 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:12.576986 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:12.577299 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:12.577314 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:12.577314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:12.577587 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:12.577733 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:12.578015 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 17:50:12.578139 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":134,"thread_start_us":80,"threads_started":1}
I20260808 17:50:12.581661 29675 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:50:12.582110 29675 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:50:12.583724 29675 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 41db61ecce6d4cb39732d7e61edb46b0: Generated new TSK 0
I20260808 17:50:12.583860 29675 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
I20260808 17:50:12.609733 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:43677
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:36295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:12.688845 29691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:12.689031 29691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:12.689052 29691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:12.690196 29691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:12.690237 29691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:12.690263 29691 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:50:12.691655 29691 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:36295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:43677
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29691
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:12.691825 29691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:12.692008 29691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:12.696516 29701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:12.696550 29700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:12.696557 29705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:12.696694 29691 server_base.cc:1034] running on GCE node
I20260808 17:50:12.696928 29691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:12.697146 29691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:12.698276 29691 hybrid_clock.cc:648] HybridClock initialized: now 1786211412698271 us; error 40 us; skew 500 ppm
Aug 08 17:50:12 dist-test-slave-bndk krb5kdc[29534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211412, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:12.700619 29691 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:50:12.700995 29691 webserver.cc:460] Webserver started at http://127.28.213.129:32957/ using document root <none> and password file <none>
I20260808 17:50:12.701196 29691 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:12.701275 29691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:12.701421 29691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:12.702390 29691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "f622011f2ade4488a60f91ebf5ce0578"
format_stamp: "Formatted at 2026-08-08 17:50:12 on dist-test-slave-bndk"
server_key: "55a9d566c9aa2eadbc213060b66a0178"
server_key_iv: "7c58b6b665a90383d58cf141131002c2"
server_key_version: "encryptionkey@0"
I20260808 17:50:12.702726 29691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "f622011f2ade4488a60f91ebf5ce0578"
format_stamp: "Formatted at 2026-08-08 17:50:12 on dist-test-slave-bndk"
server_key: "55a9d566c9aa2eadbc213060b66a0178"
server_key_iv: "7c58b6b665a90383d58cf141131002c2"
server_key_version: "encryptionkey@0"
I20260808 17:50:12.703935 29691 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:50:12.704571 29717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:12.704712 29691 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:12.704792 29691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "f622011f2ade4488a60f91ebf5ce0578"
format_stamp: "Formatted at 2026-08-08 17:50:12 on dist-test-slave-bndk"
server_key: "55a9d566c9aa2eadbc213060b66a0178"
server_key_iv: "7c58b6b665a90383d58cf141131002c2"
server_key_version: "encryptionkey@0"
I20260808 17:50:12.704856 29691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:12.718716 29691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:12.720216 29691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:12.720340 29691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:12.720532 29691 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:12.720798 29691 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:12.720829 29691 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:12.720856 29691 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:12.720880 29691 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:12.726583 29691 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:36931
I20260808 17:50:12.726655 29877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:36931 every 8 connection(s)
I20260808 17:50:12.726899 29691 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
Aug 08 17:50:12 dist-test-slave-bndk krb5kdc[29534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211412, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:12.734221 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 29691
I20260808 17:50:12.734302 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:50:12.734433 29526 external_mini_cluster.cc:1428] Setting key 7f83ff4ce3800487960b1a4a9c402b52
I20260808 17:50:12.735162 29655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:12.727529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:39805 (local address 127.28.213.190:43677)
0808 17:50:12.727585 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:12.727587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:12.727798 (+ 211us) server_negotiation.cc:407] Connection header received
0808 17:50:12.728261 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:12.728262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:12.728280 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:12.728329 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:12.729195 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:12.729729 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:12.730665 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:12.730867 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:12.730922 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:12.732757 (+ 1835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:12.732758 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:12.732759 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:12.732766 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:12.733849 (+ 1083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:12.734224 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:12.734226 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:12.734226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:12.734280 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:12.734536 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:12.734537 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:12.734537 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:12.734642 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:12.734707 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:12.735000 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 17:50:12.735090 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:50:12.735355 29884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:12.727527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:43677 (local address 127.28.213.129:39805)
0808 17:50:12.727680 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:12.727720 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:12.728169 (+ 449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:12.728393 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:12.728397 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:12.728922 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:12.729099 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:12.729104 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:12.729812 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:12.729813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:12.730582 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:12.730585 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:12.730939 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:12.730940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:12.731054 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:12.731434 (+ 380us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:12.731441 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:12.732667 (+ 1226us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:12.733926 (+ 1259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:12.733933 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:12.733935 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:12.734158 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:12.734355 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:12.734356 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:12.734356 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:12.734459 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:12.734703 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:12.734710 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:12.734863 (+ 153us) client_negotiation.cc:769] Sending connection context
0808 17:50:12.734980 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 17:50:12.735144 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":82,"threads_started":1}
I20260808 17:50:12.735814 29881 heartbeater.cc:347] Connected to a master server at 127.28.213.190:43677
I20260808 17:50:12.735906 29881 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:12.736085 29881 heartbeater.cc:511] Master 127.28.213.190:43677 requested a full tablet report, sending...
I20260808 17:50:12.736577 29600 ts_manager.cc:194] Registered new tserver with Master: f622011f2ade4488a60f91ebf5ce0578 (127.28.213.129:36931)
I20260808 17:50:12.737387 29600 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:39805
WARNING: no policy specified for kudu/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
I20260808 17:50:12.757814 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:43677
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:36295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:12.837268 29890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:12.837446 29890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:12.837468 29890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:12.838523 29890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:12.838555 29890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:12.838580 29890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:50:12.839933 29890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:36295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:43677
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:12.840096 29890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:12.840267 29890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:12.844775 29903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:12.844791 29899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:12.844799 29898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:12.844933 29890 server_base.cc:1034] running on GCE node
I20260808 17:50:12.845188 29890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:12.845448 29890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:12.846583 29890 hybrid_clock.cc:648] HybridClock initialized: now 1786211412846571 us; error 23 us; skew 500 ppm
Aug 08 17:50:12 dist-test-slave-bndk krb5kdc[29534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211412, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:12.848919 29890 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:50:12.849323 29890 webserver.cc:460] Webserver started at http://127.28.213.130:46041/ using document root <none> and password file <none>
I20260808 17:50:12.849538 29890 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:12.849586 29890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:12.849705 29890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:12.850811 29890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "a4a147d6e6db41a78c99123d88bd2f75"
format_stamp: "Formatted at 2026-08-08 17:50:12 on dist-test-slave-bndk"
server_key: "ed5e7205ac7cab0155e3445d2fd1aa67"
server_key_iv: "bf0f73ae4d046cee0f887401dbe63044"
server_key_version: "encryptionkey@0"
I20260808 17:50:12.851164 29890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "a4a147d6e6db41a78c99123d88bd2f75"
format_stamp: "Formatted at 2026-08-08 17:50:12 on dist-test-slave-bndk"
server_key: "ed5e7205ac7cab0155e3445d2fd1aa67"
server_key_iv: "bf0f73ae4d046cee0f887401dbe63044"
server_key_version: "encryptionkey@0"
I20260808 17:50:12.852367 29890 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:50:12.853012 29914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:12.853165 29890 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:12.853262 29890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "a4a147d6e6db41a78c99123d88bd2f75"
format_stamp: "Formatted at 2026-08-08 17:50:12 on dist-test-slave-bndk"
server_key: "ed5e7205ac7cab0155e3445d2fd1aa67"
server_key_iv: "bf0f73ae4d046cee0f887401dbe63044"
server_key_version: "encryptionkey@0"
I20260808 17:50:12.853329 29890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:12.864090 29890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:12.865792 29890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:12.865943 29890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:12.866155 29890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:12.866454 29890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:12.866488 29890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:12.866514 29890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:12.866530 29890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:12.872053 29890 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:44639
I20260808 17:50:12.872119 30074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:44639 every 8 connection(s)
I20260808 17:50:12.872376 29890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
Aug 08 17:50:12 dist-test-slave-bndk krb5kdc[29534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211412, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:12.880051 29655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:12.873006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:32907 (local address 127.28.213.190:43677)
0808 17:50:12.873060 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:12.873063 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:12.873226 (+ 163us) server_negotiation.cc:407] Connection header received
0808 17:50:12.873708 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:12.873709 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:12.873719 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:12.873773 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:12.874612 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:12.875092 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:12.875966 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:12.876138 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:12.876181 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:12.878018 (+ 1837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:12.878019 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:12.878020 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:12.878026 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:12.879066 (+ 1040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:12.879385 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:12.879386 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:12.879386 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:12.879430 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:12.879598 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:12.879599 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:12.879599 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:12.879691 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:12.879733 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:12.879925 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 17:50:12.879989 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 17:50:12.880199 30077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:12.872961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:43677 (local address 127.28.213.130:32907)
0808 17:50:12.873110 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:12.873149 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:12.873623 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:12.873823 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:12.873826 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:12.874366 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:12.874545 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:12.874550 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:12.875150 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:12.875151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:12.875909 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:12.875911 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:12.876189 (+ 278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:12.876189 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:12.876278 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:12.876643 (+ 365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:12.876649 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:12.877939 (+ 1290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:12.879129 (+ 1190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:12.879134 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:12.879136 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:12.879331 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:12.879473 (+ 142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:12.879474 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:12.879474 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:12.879558 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:12.879731 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:12.879733 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:12.879832 (+ 99us) client_negotiation.cc:769] Sending connection context
0808 17:50:12.879908 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 17:50:12.880017 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":81,"threads_started":1}
I20260808 17:50:12.880630 30075 heartbeater.cc:347] Connected to a master server at 127.28.213.190:43677
I20260808 17:50:12.880714 30075 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:12.880869 30075 heartbeater.cc:511] Master 127.28.213.190:43677 requested a full tablet report, sending...
I20260808 17:50:12.881202 29600 ts_manager.cc:194] Registered new tserver with Master: a4a147d6e6db41a78c99123d88bd2f75 (127.28.213.130:44639)
I20260808 17:50:12.881588 29600 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:32907
I20260808 17:50:12.882139 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 29890
I20260808 17:50:12.882208 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:50:12.882339 29526 external_mini_cluster.cc:1428] Setting key c774582f8656812b7fc96e7705fb804d
WARNING: no policy specified for kudu/127.28.213.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
I20260808 17:50:12.904904 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:43677
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:36295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:12.984642 30084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:12.984825 30084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:12.984846 30084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:12.985962 30084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:12.986002 30084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:12.986029 30084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:50:12.987421 30084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:36295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:43677
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30084
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:12.987620 30084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:12.987821 30084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 17:50:12.992509 30084 server_base.cc:1034] running on GCE node
W20260808 17:50:12.992480 30092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:12.992468 30093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:12.992479 30097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:12.992915 30084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:12.993135 30084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:12.994267 30084 hybrid_clock.cc:648] HybridClock initialized: now 1786211412994266 us; error 42 us; skew 500 ppm
Aug 08 17:50:12 dist-test-slave-bndk krb5kdc[29534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211412, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:12.996629 30084 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:50:12.997057 30084 webserver.cc:460] Webserver started at http://127.28.213.131:36703/ using document root <none> and password file <none>
I20260808 17:50:12.997280 30084 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:12.997329 30084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:12.997452 30084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:12.998422 30084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "929f48d3545545afae6035eb8e27f438"
format_stamp: "Formatted at 2026-08-08 17:50:12 on dist-test-slave-bndk"
server_key: "a09221689490eb52d2509b52637011f5"
server_key_iv: "2659ba9a8518112473a162e6223997ea"
server_key_version: "encryptionkey@0"
I20260808 17:50:12.998745 30084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "929f48d3545545afae6035eb8e27f438"
format_stamp: "Formatted at 2026-08-08 17:50:12 on dist-test-slave-bndk"
server_key: "a09221689490eb52d2509b52637011f5"
server_key_iv: "2659ba9a8518112473a162e6223997ea"
server_key_version: "encryptionkey@0"
I20260808 17:50:12.999940 30084 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:50:13.000573 30112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:13.000715 30084 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:13.000797 30084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "929f48d3545545afae6035eb8e27f438"
format_stamp: "Formatted at 2026-08-08 17:50:12 on dist-test-slave-bndk"
server_key: "a09221689490eb52d2509b52637011f5"
server_key_iv: "2659ba9a8518112473a162e6223997ea"
server_key_version: "encryptionkey@0"
I20260808 17:50:13.000857 30084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:13.007707 30084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:13.009716 30084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:13.009841 30084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:13.010032 30084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:13.010331 30084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:13.010365 30084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:13.010383 30084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:13.010401 30084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:13.015918 30084 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:45021
I20260808 17:50:13.015954 30277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:45021 every 8 connection(s)
I20260808 17:50:13.016218 30084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:50:13.019217 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 30084
I20260808 17:50:13.019295 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:50:13.019461 29526 external_mini_cluster.cc:1428] Setting key 8ab80b42bebac178f87ab178495a3bdf
Aug 08 17:50:13 dist-test-slave-bndk krb5kdc[29534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211412, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:13.024681 29655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:13.016841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:46177 (local address 127.28.213.190:43677)
0808 17:50:13.016888 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:13.016890 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:13.017061 (+ 171us) server_negotiation.cc:407] Connection header received
0808 17:50:13.017589 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:13.017590 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:13.017602 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:13.017648 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:13.018544 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:13.019033 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:13.020271 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:13.020541 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:13.020608 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:13.022480 (+ 1872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:13.022482 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:13.022482 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:13.022489 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:13.023715 (+ 1226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:13.024014 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:13.024015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:13.024015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:13.024063 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:13.024227 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:13.024227 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:13.024228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:13.024318 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:13.024360 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:13.024556 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 17:50:13.024620 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:50:13.024814 30282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:13.016802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:43677 (local address 127.28.213.131:46177)
0808 17:50:13.016955 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:13.016987 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:13.017496 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:13.017724 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:13.017729 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:13.018264 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:13.018454 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:13.018459 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:13.019129 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:13.019130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:13.020186 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:13.020189 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:13.020618 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:13.020619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:13.020720 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:13.021090 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:13.021097 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:13.022399 (+ 1302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:13.023774 (+ 1375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:13.023776 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:13.023778 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:13.023963 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:13.024104 (+ 141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:13.024105 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:13.024105 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:13.024187 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:13.024358 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:13.024361 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:13.024464 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 17:50:13.024537 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 17:50:13.024645 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":78,"threads_started":1}
I20260808 17:50:13.025195 30278 heartbeater.cc:347] Connected to a master server at 127.28.213.190:43677
I20260808 17:50:13.025317 30278 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:13.025485 30278 heartbeater.cc:511] Master 127.28.213.190:43677 requested a full tablet report, sending...
I20260808 17:50:13.025799 29600 ts_manager.cc:194] Registered new tserver with Master: 929f48d3545545afae6035eb8e27f438 (127.28.213.131:45021)
I20260808 17:50:13.026126 29600 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:46177
I20260808 17:50:13.031111 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 17:50:13 dist-test-slave-bndk krb5kdc[29534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211413, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 17:50:13 dist-test-slave-bndk krb5kdc[29534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211413, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.213.129@KRBTEST.COM
I20260808 17:50:13.052644 30290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:13.046196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50116 (local address 127.28.213.129:36931)
0808 17:50:13.046363 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:13.046366 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:13.046376 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:50:13.046400 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:13.046402 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:13.046415 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:13.046477 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:13.046953 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:13.047622 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:13.048263 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:13.048535 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:13.048580 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:13.050559 (+ 1979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:13.050566 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:13.050566 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:13.050572 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:13.051797 (+ 1225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:13.052084 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:13.052086 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:13.052087 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:13.052148 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:13.052272 (+ 124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:13.052272 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:13.052272 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:13.052384 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:13.052478 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:13.052516 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 17:50:13.052572 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":96,"threads_started":1}
W20260808 17:50:13.053025 29757 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50116
Aug 08 17:50:13 dist-test-slave-bndk krb5kdc[29534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 17:50:13 dist-test-slave-bndk krb5kdc[29534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.129@KRBTEST.COM
I20260808 17:50:13.072885 30290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:13.067220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50118 (local address 127.28.213.129:36931)
0808 17:50:13.067266 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:13.067267 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:13.067347 (+ 80us) server_negotiation.cc:407] Connection header received
0808 17:50:13.067389 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:13.067390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:13.067398 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:13.067453 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:13.067887 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:13.068327 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:13.068959 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:13.069134 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:13.069175 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:13.071023 (+ 1848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:13.071024 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:13.071024 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:13.071031 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:13.072077 (+ 1046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:13.072386 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:13.072387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:13.072387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:13.072438 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:13.072561 (+ 123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:13.072561 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:13.072562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:13.072635 (+ 73us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:13.072711 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:13.072770 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 17:50:13.072826 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 17:50:13.073302 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 29691
I20260808 17:50:13.096493 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 29890
I20260808 17:50:13.115561 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 30084
I20260808 17:50:13.126953 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 29553
2026-08-08T17:50:13Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (1946 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:50:13 dist-test-slave-bndk krb5kdc[30301](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:50:13 dist-test-slave-bndk krb5kdc[30301](info): set up 2 sockets
Aug 08 17:50:13 dist-test-slave-bndk krb5kdc[30301](info): commencing operation
krb5kdc: starting...
W20260808 17:50:14.254448 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:50:14 dist-test-slave-bndk krb5kdc[30301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211414, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:50:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:50:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:50:14.365774 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:36497
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:45179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:36497
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:14.445057 30326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:14.445266 30326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:14.445297 30326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:14.446357 30326 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:14.446395 30326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:14.446408 30326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:14.446420 30326 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:14.446430 30326 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:50:14.447784 30326 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:45179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:36497
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:36497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:14.447962 30326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:14.448120 30326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:14.452525 30331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:14.452512 30333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:14.452585 30326 server_base.cc:1034] running on GCE node
W20260808 17:50:14.452510 30336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:14.452921 30326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:14.453154 30326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:14.454306 30326 hybrid_clock.cc:648] HybridClock initialized: now 1786211414454288 us; error 33 us; skew 500 ppm
Aug 08 17:50:14 dist-test-slave-bndk krb5kdc[30301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211414, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:14.456590 30326 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:50:14.456952 30326 webserver.cc:460] Webserver started at http://127.28.213.190:45813/ using document root <none> and password file <none>
I20260808 17:50:14.457114 30326 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:14.457150 30326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:14.457273 30326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:14.458192 30326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "724effc06cd440ff9127ceabff3e168c"
format_stamp: "Formatted at 2026-08-08 17:50:14 on dist-test-slave-bndk"
server_key: "8287760f60364df2ed9bdfebf4e02fa3"
server_key_iv: "365c52e3dbeb167b227e4d6f77360ebb"
server_key_version: "encryptionkey@0"
I20260808 17:50:14.458487 30326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "724effc06cd440ff9127ceabff3e168c"
format_stamp: "Formatted at 2026-08-08 17:50:14 on dist-test-slave-bndk"
server_key: "8287760f60364df2ed9bdfebf4e02fa3"
server_key_iv: "365c52e3dbeb167b227e4d6f77360ebb"
server_key_version: "encryptionkey@0"
I20260808 17:50:14.459625 30326 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:50:14.460218 30347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:14.460355 30326 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:14.460434 30326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "724effc06cd440ff9127ceabff3e168c"
format_stamp: "Formatted at 2026-08-08 17:50:14 on dist-test-slave-bndk"
server_key: "8287760f60364df2ed9bdfebf4e02fa3"
server_key_iv: "365c52e3dbeb167b227e4d6f77360ebb"
server_key_version: "encryptionkey@0"
I20260808 17:50:14.460487 30326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:14.468225 30326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:14.469843 30326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:14.469949 30326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:14.473577 30326 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:36497
I20260808 17:50:14.473611 30422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:36497 every 8 connection(s)
I20260808 17:50:14.473896 30326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:50:14.474690 30424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:14.476806 30424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c: Bootstrap starting.
I20260808 17:50:14.477383 30424 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:14.477640 30424 log.cc:824] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:14.478273 30424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c: No bootstrap required, opened a new log
I20260808 17:50:14.479532 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 30326
I20260808 17:50:14.479619 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:50:14.479768 29526 external_mini_cluster.cc:1428] Setting key a8ad5c254a1c67d8c7b1f5c1deca0589
I20260808 17:50:14.480223 30424 raft_consensus.cc:348] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "724effc06cd440ff9127ceabff3e168c" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36497 } }
I20260808 17:50:14.480400 30424 raft_consensus.cc:374] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:14.480440 30424 raft_consensus.cc:729] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 724effc06cd440ff9127ceabff3e168c, State: Initialized, Role: FOLLOWER
I20260808 17:50:14.480558 30424 consensus_queue.cc:260] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "724effc06cd440ff9127ceabff3e168c" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36497 } }
I20260808 17:50:14.480615 30424 raft_consensus.cc:388] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:50:14.480635 30424 raft_consensus.cc:482] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:50:14.480667 30424 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:14.481609 30424 raft_consensus.cc:504] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "724effc06cd440ff9127ceabff3e168c" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36497 } }
I20260808 17:50:14.481698 30424 leader_election.cc:302] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 724effc06cd440ff9127ceabff3e168c; no voters:
I20260808 17:50:14.481840 30424 leader_election.cc:288] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:50:14.481882 30431 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:14.481998 30431 raft_consensus.cc:686] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c [term 1 LEADER]: Becoming Leader. State: Replica: 724effc06cd440ff9127ceabff3e168c, State: Running, Role: LEADER
I20260808 17:50:14.482084 30424 sys_catalog.cc:564] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:14.482086 30431 consensus_queue.cc:237] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "724effc06cd440ff9127ceabff3e168c" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36497 } }
I20260808 17:50:14.482426 30431 sys_catalog.cc:455] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 724effc06cd440ff9127ceabff3e168c. Latest consensus state: current_term: 1 leader_uuid: "724effc06cd440ff9127ceabff3e168c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "724effc06cd440ff9127ceabff3e168c" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36497 } } }
I20260808 17:50:14.482509 30431 sys_catalog.cc:458] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:14.482435 30435 sys_catalog.cc:455] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "724effc06cd440ff9127ceabff3e168c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "724effc06cd440ff9127ceabff3e168c" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36497 } } }
I20260808 17:50:14.482656 30435 sys_catalog.cc:458] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:14.482712 30442 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:50:14.483201 30442 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:50:14.484617 30459 mvcc.cc:205] Tried to move back new op lower bound from 7316321953727139840 to 7316321953719083008. Current Snapshot: MvccSnapshot[applied={T|T < 7316321953727139840}]
Aug 08 17:50:14 dist-test-slave-bndk krb5kdc[30301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211414, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:14.486217 30442 catalog_manager.cc:1347] Generated new cluster ID: f2283026f2894bdc8012cf9a4574650f
I20260808 17:50:14.486267 30442 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:50:14.489348 30430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:14.480236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53784 (local address 127.28.213.190:36497)
0808 17:50:14.480437 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:14.480447 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:14.480477 (+ 30us) server_negotiation.cc:407] Connection header received
0808 17:50:14.480589 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:14.480595 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:14.480647 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:14.480773 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:14.481415 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.482628 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.483627 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.484047 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.484419 (+ 372us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:14.486568 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:14.486572 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:14.486572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:14.486584 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:14.488014 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:14.488311 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:14.488314 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:14.488315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:14.488409 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:14.488582 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:14.488583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:14.488583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:14.488791 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:14.488947 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:14.489015 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 17:50:14.489144 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":102,"threads_started":1}
I20260808 17:50:14.492900 30442 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:50:14.493579 30442 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:50:14.500180 30442 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 724effc06cd440ff9127ceabff3e168c: Generated new TSK 0
I20260808 17:50:14.500326 30442 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
I20260808 17:50:14.527936 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:36497
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:45179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:14.627799 30464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:14.627997 30464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:14.628032 30464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:14.629136 30464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:14.629175 30464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:14.629210 30464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:50:14.630645 30464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:45179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:36497
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:14.630867 30464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:14.631065 30464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:14.635668 30470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:14.635820 30464 server_base.cc:1034] running on GCE node
W20260808 17:50:14.635674 30469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:14.635691 30472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:14.636111 30464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:14.636319 30464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:14.637452 30464 hybrid_clock.cc:648] HybridClock initialized: now 1786211414637428 us; error 34 us; skew 500 ppm
Aug 08 17:50:14 dist-test-slave-bndk krb5kdc[30301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211414, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:14.639703 30464 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:50:14.640089 30464 webserver.cc:460] Webserver started at http://127.28.213.129:36631/ using document root <none> and password file <none>
I20260808 17:50:14.640273 30464 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:14.640319 30464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:14.640443 30464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:14.641427 30464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "7d15b587da424d60938ad107ab477a86"
format_stamp: "Formatted at 2026-08-08 17:50:14 on dist-test-slave-bndk"
server_key: "37ea71638b86118c0ebc815bcc0e631e"
server_key_iv: "6c429292b9e9a39ab919a4f871909faa"
server_key_version: "encryptionkey@0"
I20260808 17:50:14.641746 30464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "7d15b587da424d60938ad107ab477a86"
format_stamp: "Formatted at 2026-08-08 17:50:14 on dist-test-slave-bndk"
server_key: "37ea71638b86118c0ebc815bcc0e631e"
server_key_iv: "6c429292b9e9a39ab919a4f871909faa"
server_key_version: "encryptionkey@0"
I20260808 17:50:14.642935 30464 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:14.643560 30485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:14.643703 30464 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:14.643784 30464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "7d15b587da424d60938ad107ab477a86"
format_stamp: "Formatted at 2026-08-08 17:50:14 on dist-test-slave-bndk"
server_key: "37ea71638b86118c0ebc815bcc0e631e"
server_key_iv: "6c429292b9e9a39ab919a4f871909faa"
server_key_version: "encryptionkey@0"
I20260808 17:50:14.643842 30464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:14.660168 30464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:14.661816 30464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:14.661966 30464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:14.662156 30464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:14.662421 30464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:14.662456 30464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:14.662482 30464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:14.662505 30464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:14.667733 30464 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:32887
I20260808 17:50:14.667786 30652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:32887 every 8 connection(s)
I20260808 17:50:14.668064 30464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:50:14.672663 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 30464
I20260808 17:50:14.672753 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:50:14.672930 29526 external_mini_cluster.cc:1428] Setting key 1dc05b49a1ac3ba62496ab71e6244934
Aug 08 17:50:14 dist-test-slave-bndk krb5kdc[30301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211414, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:14.676518 30430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:14.668711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:44537 (local address 127.28.213.190:36497)
0808 17:50:14.668781 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:14.668783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:14.668939 (+ 156us) server_negotiation.cc:407] Connection header received
0808 17:50:14.669897 (+ 958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:14.669899 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:14.669913 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:14.669963 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:14.670481 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.670969 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.671885 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.672068 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.672112 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:14.674164 (+ 2052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:14.674165 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:14.674165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:14.674173 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:14.675295 (+ 1122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:14.675660 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:14.675661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:14.675662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:14.675717 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:14.675931 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:14.675932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:14.675932 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:14.676038 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:14.676095 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:14.676342 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 17:50:14.676431 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 17:50:14.676662 30655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:14.668680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:36497 (local address 127.28.213.129:44537)
0808 17:50:14.668834 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:14.668866 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:14.669814 (+ 948us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:14.670014 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:14.670017 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:14.670243 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:14.670420 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:14.670424 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.671027 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.671027 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:14.671824 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:14.671826 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.672121 (+ 295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.672121 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:14.672212 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:14.672606 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:14.672615 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:14.674081 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:14.675367 (+ 1286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:14.675374 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:14.675376 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:14.675593 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:14.675770 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:14.675770 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:14.675771 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:14.675871 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:14.676093 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:14.676100 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:14.676226 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 17:50:14.676310 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 17:50:14.676465 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":80,"threads_started":1}
I20260808 17:50:14.677202 30653 heartbeater.cc:347] Connected to a master server at 127.28.213.190:36497
I20260808 17:50:14.677323 30653 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:14.677496 30653 heartbeater.cc:511] Master 127.28.213.190:36497 requested a full tablet report, sending...
I20260808 17:50:14.677995 30376 ts_manager.cc:194] Registered new tserver with Master: 7d15b587da424d60938ad107ab477a86 (127.28.213.129:32887)
I20260808 17:50:14.678563 30376 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:44537
WARNING: no policy specified for kudu/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
I20260808 17:50:14.696401 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:36497
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:45179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:14.773713 30658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:14.773895 30658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:14.773927 30658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:14.775028 30658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:14.775068 30658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:14.775102 30658 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:50:14.776522 30658 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:45179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:36497
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30658
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:14.776741 30658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:14.776937 30658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:14.781473 30667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:14.781483 30666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:14.781555 30658 server_base.cc:1034] running on GCE node
W20260808 17:50:14.781483 30670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:14.781816 30658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:14.782054 30658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:14.783206 30658 hybrid_clock.cc:648] HybridClock initialized: now 1786211414783189 us; error 32 us; skew 500 ppm
Aug 08 17:50:14 dist-test-slave-bndk krb5kdc[30301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211414, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:14.785459 30658 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:50:14.785830 30658 webserver.cc:460] Webserver started at http://127.28.213.130:38769/ using document root <none> and password file <none>
I20260808 17:50:14.786031 30658 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:14.786077 30658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:14.786194 30658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:14.787127 30658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "eafb709a6c2043a6ae9f40aa64173d43"
format_stamp: "Formatted at 2026-08-08 17:50:14 on dist-test-slave-bndk"
server_key: "9762fd232d871f34a695c3194c9a5f4b"
server_key_iv: "8b34942935bb96890fbc1367e5e558e2"
server_key_version: "encryptionkey@0"
I20260808 17:50:14.787436 30658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "eafb709a6c2043a6ae9f40aa64173d43"
format_stamp: "Formatted at 2026-08-08 17:50:14 on dist-test-slave-bndk"
server_key: "9762fd232d871f34a695c3194c9a5f4b"
server_key_iv: "8b34942935bb96890fbc1367e5e558e2"
server_key_version: "encryptionkey@0"
I20260808 17:50:14.788614 30658 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:50:14.789245 30683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:14.789386 30658 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:14.789466 30658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "eafb709a6c2043a6ae9f40aa64173d43"
format_stamp: "Formatted at 2026-08-08 17:50:14 on dist-test-slave-bndk"
server_key: "9762fd232d871f34a695c3194c9a5f4b"
server_key_iv: "8b34942935bb96890fbc1367e5e558e2"
server_key_version: "encryptionkey@0"
I20260808 17:50:14.789531 30658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:14.802181 30658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:14.803696 30658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:14.803817 30658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:14.804005 30658 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:14.804262 30658 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:14.804296 30658 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:14.804322 30658 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:14.804347 30658 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:14.809772 30658 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:42479
I20260808 17:50:14.809806 30853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:42479 every 8 connection(s)
I20260808 17:50:14.810076 30658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:50:14.810395 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 30658
I20260808 17:50:14.810472 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:50:14.810637 29526 external_mini_cluster.cc:1428] Setting key bd48d70907ad351e8cbfe93366b07561
Aug 08 17:50:14 dist-test-slave-bndk krb5kdc[30301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211414, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:14.819388 30430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:14.810756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:47037 (local address 127.28.213.190:36497)
0808 17:50:14.810803 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:14.810806 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:14.811017 (+ 211us) server_negotiation.cc:407] Connection header received
0808 17:50:14.812085 (+ 1068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:14.812086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:14.812097 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:14.812145 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:14.812851 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.813497 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.814418 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.814607 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.814663 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:14.816849 (+ 2186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:14.816850 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:14.816850 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:14.816857 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:14.818092 (+ 1235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:14.818548 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:14.818548 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:14.818549 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:14.818594 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:14.818834 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:14.818834 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:14.818835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:14.818930 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:14.818972 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:14.819268 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 17:50:14.819327 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:50:14.819629 30857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:14.810727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:36497 (local address 127.28.213.130:47037)
0808 17:50:14.810894 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:14.810936 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:14.811981 (+ 1045us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:14.812221 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:14.812225 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:14.812539 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:14.812778 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:14.812784 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.813564 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.813565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:14.814333 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:14.814335 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.814674 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.814675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:14.814802 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:14.815209 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:14.815217 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:14.816760 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:14.818170 (+ 1410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:14.818176 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:14.818179 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:14.818478 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:14.818647 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:14.818648 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:14.818648 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:14.818777 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:14.818982 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:14.818988 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:14.819139 (+ 151us) client_negotiation.cc:769] Sending connection context
0808 17:50:14.819252 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 17:50:14.819419 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":82,"threads_started":1}
WARNING: no policy specified for kudu/127.28.213.131@KRBTEST.COM; defaulting to no policy
I20260808 17:50:14.820081 30855 heartbeater.cc:347] Connected to a master server at 127.28.213.190:36497
I20260808 17:50:14.820163 30855 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:14.820317 30855 heartbeater.cc:511] Master 127.28.213.190:36497 requested a full tablet report, sending...
I20260808 17:50:14.820659 30376 ts_manager.cc:194] Registered new tserver with Master: eafb709a6c2043a6ae9f40aa64173d43 (127.28.213.130:42479)
I20260808 17:50:14.821038 30376 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:47037
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
I20260808 17:50:14.834887 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:36497
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:45179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:14.913671 30860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:14.913849 30860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:14.913869 30860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:14.914973 30860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:14.915010 30860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:14.915040 30860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:50:14.916487 30860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:45179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:36497
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:14.916693 30860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:14.916906 30860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:14.921461 30867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:14.921494 30860 server_base.cc:1034] running on GCE node
W20260808 17:50:14.921430 30866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:14.921417 30870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:14.921837 30860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:14.922045 30860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:14.923179 30860 hybrid_clock.cc:648] HybridClock initialized: now 1786211414923164 us; error 27 us; skew 500 ppm
Aug 08 17:50:14 dist-test-slave-bndk krb5kdc[30301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211414, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:14.925413 30860 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:50:14.925809 30860 webserver.cc:460] Webserver started at http://127.28.213.131:43799/ using document root <none> and password file <none>
I20260808 17:50:14.926010 30860 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:14.926057 30860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:14.926177 30860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:14.927116 30860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "10556ef61a964874ac7579ff0a9e0c7c"
format_stamp: "Formatted at 2026-08-08 17:50:14 on dist-test-slave-bndk"
server_key: "91c910b2f286c37261e5e04814eaa20c"
server_key_iv: "eb8469f8cfe8cd57a7a87d0321dcf26c"
server_key_version: "encryptionkey@0"
I20260808 17:50:14.927441 30860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "10556ef61a964874ac7579ff0a9e0c7c"
format_stamp: "Formatted at 2026-08-08 17:50:14 on dist-test-slave-bndk"
server_key: "91c910b2f286c37261e5e04814eaa20c"
server_key_iv: "eb8469f8cfe8cd57a7a87d0321dcf26c"
server_key_version: "encryptionkey@0"
I20260808 17:50:14.928617 30860 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:50:14.929260 30883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:14.929414 30860 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:14.929495 30860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "10556ef61a964874ac7579ff0a9e0c7c"
format_stamp: "Formatted at 2026-08-08 17:50:14 on dist-test-slave-bndk"
server_key: "91c910b2f286c37261e5e04814eaa20c"
server_key_iv: "eb8469f8cfe8cd57a7a87d0321dcf26c"
server_key_version: "encryptionkey@0"
I20260808 17:50:14.929558 30860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:14.942374 30860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:14.943881 30860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:14.944005 30860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:14.944190 30860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:14.944458 30860 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:14.944491 30860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:14.944516 30860 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:14.944535 30860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:14.950109 30860 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:40579
I20260808 17:50:14.950146 31057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:40579 every 8 connection(s)
I20260808 17:50:14.950417 30860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
Aug 08 17:50:14 dist-test-slave-bndk krb5kdc[30301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211414, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:14.958807 30430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:14.951070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:52845 (local address 127.28.213.190:36497)
0808 17:50:14.951128 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:14.951130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:14.951286 (+ 156us) server_negotiation.cc:407] Connection header received
0808 17:50:14.952127 (+ 841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:14.952129 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:14.952142 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:14.952188 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:14.952754 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.953289 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.954220 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.954416 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.954470 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:14.956313 (+ 1843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:14.956314 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:14.956314 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:14.956322 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:14.957583 (+ 1261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:14.957937 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:14.957939 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:14.957939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:14.957999 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:14.958205 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:14.958206 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:14.958206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:14.958317 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:14.958373 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:14.958620 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 17:50:14.958696 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 17:50:14.958916 31061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:14.951016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:36497 (local address 127.28.213.131:52845)
0808 17:50:14.951176 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:14.951207 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:14.952030 (+ 823us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:14.952264 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:14.952267 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:14.952498 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:14.952669 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:14.952672 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.953362 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.953363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:14.954139 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:14.954142 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.954482 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.954483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:14.954588 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:14.955003 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:14.955011 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:14.956226 (+ 1215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:14.957655 (+ 1429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:14.957661 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:14.957663 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:14.957866 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:14.958050 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:14.958051 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:14.958052 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:14.958150 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:14.958370 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:14.958376 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:14.958505 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 17:50:14.958589 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 17:50:14.958727 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":80,"threads_started":1}
I20260808 17:50:14.958949 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 30860
I20260808 17:50:14.959043 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:50:14.959193 29526 external_mini_cluster.cc:1428] Setting key bbe33a98d8ace9584bcfca623ec08826
I20260808 17:50:14.959532 31059 heartbeater.cc:347] Connected to a master server at 127.28.213.190:36497
I20260808 17:50:14.959622 31059 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:14.959796 31059 heartbeater.cc:511] Master 127.28.213.190:36497 requested a full tablet report, sending...
I20260808 17:50:14.960156 30376 ts_manager.cc:194] Registered new tserver with Master: 10556ef61a964874ac7579ff0a9e0c7c (127.28.213.131:40579)
I20260808 17:50:14.960516 30376 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:52845
I20260808 17:50:14.970579 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:50:14.976879 30430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:14.972026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53792 (local address 127.28.213.190:36497)
0808 17:50:14.972088 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:14.972090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:14.972166 (+ 76us) server_negotiation.cc:407] Connection header received
0808 17:50:14.972215 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:14.972216 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:14.972224 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:14.972262 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:14.972738 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.973182 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.973848 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.974024 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.974065 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:14.975038 (+ 973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:14.975039 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:14.975039 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:14.975043 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:14.976058 (+ 1015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:14.976329 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:14.976329 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:14.976329 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:14.976371 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:14.976516 (+ 145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:14.976517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:14.976517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:14.976626 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:14.976691 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:14.976766 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 17:50:14.976822 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 17:50:14.978839 30376 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53792:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:50:14.980370 30376 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:50:14.986589 31072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:14.982365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:32887 (local address 127.0.0.1:60746)
0808 17:50:14.982497 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:14.982538 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:14.982600 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:14.983058 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:14.983059 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:14.983061 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:14.983116 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:14.983118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.984432 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.984433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:14.985440 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:14.985443 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.986289 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.986290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:14.986371 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:14.986385 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 17:50:14.986452 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 17:50:14.986503 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":42,"thread_start_us":55,"threads_started":1}
I20260808 17:50:14.986608 31078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:14.982464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60746 (local address 127.28.213.129:32887)
0808 17:50:14.982897 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:14.982900 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:14.982907 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:50:14.982943 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:14.982945 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:14.982962 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:14.983059 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:14.983182 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.984342 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.985509 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.986135 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.986203 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:14.986252 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:14.986486 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 17:50:14.986527 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":71,"threads_started":1}
I20260808 17:50:14.986732 31084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:14.982664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32850 (local address 127.28.213.131:40579)
0808 17:50:14.982818 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:14.982822 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:14.983151 (+ 329us) server_negotiation.cc:407] Connection header received
0808 17:50:14.983188 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:14.983190 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:14.983205 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:14.983287 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:14.983613 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.984230 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.985787 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.986283 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.986348 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:14.986397 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:14.986626 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 17:50:14.986664 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":65,"threads_started":1}
I20260808 17:50:14.986830 31080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:14.982557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:40579 (local address 127.0.0.1:32850)
0808 17:50:14.983041 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:14.983050 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:14.983100 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:14.983356 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:14.983357 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:14.983359 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:14.983411 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:14.983412 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.984323 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.984324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:14.985681 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:14.985684 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.986359 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.986360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:14.986439 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:14.986445 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 17:50:14.986491 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 17:50:14.986535 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"mutex_wait_us":59,"thread_start_us":47,"threads_started":1}
I20260808 17:50:14.987481 30555 tablet_service.cc:1467] Processing CreateTablet for tablet b7bd8542acab4e24906c632ca6b8e161 (DEFAULT_TABLE table=test-table [id=c8915eb567f04b7fab64a443784c9d04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:14.987455 30955 tablet_service.cc:1467] Processing CreateTablet for tablet b7bd8542acab4e24906c632ca6b8e161 (DEFAULT_TABLE table=test-table [id=c8915eb567f04b7fab64a443784c9d04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:14.987802 30955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7bd8542acab4e24906c632ca6b8e161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:14.987805 30555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7bd8542acab4e24906c632ca6b8e161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:14.991020 31086 tablet_bootstrap.cc:492] T b7bd8542acab4e24906c632ca6b8e161 P 10556ef61a964874ac7579ff0a9e0c7c: Bootstrap starting.
I20260808 17:50:14.991165 31081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:14.982599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39014 (local address 127.28.213.130:42479)
0808 17:50:14.982811 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:14.982815 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:14.982825 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:50:14.982857 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:14.982858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:14.982870 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:14.982944 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:14.983128 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.984200 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.985765 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.986462 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.986530 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:14.986618 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:14.991044 (+ 4426us) server_negotiation.cc:299] Negotiation successful
0808 17:50:14.991091 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":99,"threads_started":1}
I20260808 17:50:14.991380 31075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:14.982374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:42479 (local address 127.0.0.1:39014)
0808 17:50:14.982675 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:14.982685 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:14.982736 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:14.982972 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:14.982976 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:14.982978 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:14.983042 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:14.983044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.984308 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.984309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:14.985688 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:14.985691 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:14.986658 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:14.986659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:14.987003 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:14.987008 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:50:14.987059 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 17:50:14.991312 (+ 4253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"mutex_wait_us":92,"thread_start_us":58,"threads_started":1}
I20260808 17:50:14.991671 31086 tablet_bootstrap.cc:654] T b7bd8542acab4e24906c632ca6b8e161 P 10556ef61a964874ac7579ff0a9e0c7c: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:14.992030 30753 tablet_service.cc:1467] Processing CreateTablet for tablet b7bd8542acab4e24906c632ca6b8e161 (DEFAULT_TABLE table=test-table [id=c8915eb567f04b7fab64a443784c9d04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:14.992314 30753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7bd8542acab4e24906c632ca6b8e161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:14.992344 31086 log.cc:824] T b7bd8542acab4e24906c632ca6b8e161 P 10556ef61a964874ac7579ff0a9e0c7c: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:14.992666 31085 tablet_bootstrap.cc:492] T b7bd8542acab4e24906c632ca6b8e161 P 7d15b587da424d60938ad107ab477a86: Bootstrap starting.
I20260808 17:50:14.993161 31086 tablet_bootstrap.cc:492] T b7bd8542acab4e24906c632ca6b8e161 P 10556ef61a964874ac7579ff0a9e0c7c: No bootstrap required, opened a new log
I20260808 17:50:14.993253 31086 ts_tablet_manager.cc:1397] T b7bd8542acab4e24906c632ca6b8e161 P 10556ef61a964874ac7579ff0a9e0c7c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:50:14.993330 31085 tablet_bootstrap.cc:654] T b7bd8542acab4e24906c632ca6b8e161 P 7d15b587da424d60938ad107ab477a86: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:14.993876 31085 log.cc:824] T b7bd8542acab4e24906c632ca6b8e161 P 7d15b587da424d60938ad107ab477a86: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:14.994657 31085 tablet_bootstrap.cc:492] T b7bd8542acab4e24906c632ca6b8e161 P 7d15b587da424d60938ad107ab477a86: No bootstrap required, opened a new log
I20260808 17:50:14.994729 31085 ts_tablet_manager.cc:1397] T b7bd8542acab4e24906c632ca6b8e161 P 7d15b587da424d60938ad107ab477a86: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 17:50:14.995107 31091 tablet_bootstrap.cc:492] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43: Bootstrap starting.
I20260808 17:50:14.995092 31086 raft_consensus.cc:348] T b7bd8542acab4e24906c632ca6b8e161 P 10556ef61a964874ac7579ff0a9e0c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d15b587da424d60938ad107ab477a86" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32887 } } peers { permanent_uuid: "10556ef61a964874ac7579ff0a9e0c7c" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40579 } } peers { permanent_uuid: "eafb709a6c2043a6ae9f40aa64173d43" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42479 } }
I20260808 17:50:14.995265 31086 raft_consensus.cc:374] T b7bd8542acab4e24906c632ca6b8e161 P 10556ef61a964874ac7579ff0a9e0c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:14.995303 31086 raft_consensus.cc:729] T b7bd8542acab4e24906c632ca6b8e161 P 10556ef61a964874ac7579ff0a9e0c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10556ef61a964874ac7579ff0a9e0c7c, State: Initialized, Role: FOLLOWER
I20260808 17:50:14.995424 31086 consensus_queue.cc:260] T b7bd8542acab4e24906c632ca6b8e161 P 10556ef61a964874ac7579ff0a9e0c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d15b587da424d60938ad107ab477a86" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32887 } } peers { permanent_uuid: "10556ef61a964874ac7579ff0a9e0c7c" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40579 } } peers { permanent_uuid: "eafb709a6c2043a6ae9f40aa64173d43" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42479 } }
I20260808 17:50:14.995687 31086 ts_tablet_manager.cc:1428] T b7bd8542acab4e24906c632ca6b8e161 P 10556ef61a964874ac7579ff0a9e0c7c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:50:14.995725 31091 tablet_bootstrap.cc:654] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:14.995805 31059 heartbeater.cc:503] Master 127.28.213.190:36497 was elected leader, sending a full tablet report...
I20260808 17:50:14.996225 31091 log.cc:824] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:14.996480 31085 raft_consensus.cc:348] T b7bd8542acab4e24906c632ca6b8e161 P 7d15b587da424d60938ad107ab477a86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d15b587da424d60938ad107ab477a86" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32887 } } peers { permanent_uuid: "10556ef61a964874ac7579ff0a9e0c7c" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40579 } } peers { permanent_uuid: "eafb709a6c2043a6ae9f40aa64173d43" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42479 } }
I20260808 17:50:14.996668 31085 raft_consensus.cc:374] T b7bd8542acab4e24906c632ca6b8e161 P 7d15b587da424d60938ad107ab477a86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:14.996718 31085 raft_consensus.cc:729] T b7bd8542acab4e24906c632ca6b8e161 P 7d15b587da424d60938ad107ab477a86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d15b587da424d60938ad107ab477a86, State: Initialized, Role: FOLLOWER
I20260808 17:50:14.996832 31085 consensus_queue.cc:260] T b7bd8542acab4e24906c632ca6b8e161 P 7d15b587da424d60938ad107ab477a86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d15b587da424d60938ad107ab477a86" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32887 } } peers { permanent_uuid: "10556ef61a964874ac7579ff0a9e0c7c" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40579 } } peers { permanent_uuid: "eafb709a6c2043a6ae9f40aa64173d43" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42479 } }
I20260808 17:50:14.996978 31091 tablet_bootstrap.cc:492] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43: No bootstrap required, opened a new log
I20260808 17:50:14.997045 31091 ts_tablet_manager.cc:1397] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:50:14.997119 31085 ts_tablet_manager.cc:1428] T b7bd8542acab4e24906c632ca6b8e161 P 7d15b587da424d60938ad107ab477a86: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 17:50:14.997140 30653 heartbeater.cc:503] Master 127.28.213.190:36497 was elected leader, sending a full tablet report...
I20260808 17:50:14.998654 31091 raft_consensus.cc:348] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d15b587da424d60938ad107ab477a86" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32887 } } peers { permanent_uuid: "10556ef61a964874ac7579ff0a9e0c7c" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40579 } } peers { permanent_uuid: "eafb709a6c2043a6ae9f40aa64173d43" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42479 } }
I20260808 17:50:14.998785 31091 raft_consensus.cc:374] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:14.998805 31091 raft_consensus.cc:729] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafb709a6c2043a6ae9f40aa64173d43, State: Initialized, Role: FOLLOWER
I20260808 17:50:14.998879 31091 consensus_queue.cc:260] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d15b587da424d60938ad107ab477a86" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32887 } } peers { permanent_uuid: "10556ef61a964874ac7579ff0a9e0c7c" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40579 } } peers { permanent_uuid: "eafb709a6c2043a6ae9f40aa64173d43" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42479 } }
I20260808 17:50:14.999059 31091 ts_tablet_manager.cc:1428] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:50:14.999104 30855 heartbeater.cc:503] Master 127.28.213.190:36497 was elected leader, sending a full tablet report...
W20260808 17:50:15.060572 30856 tablet.cc:2369] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:50:15.086190 31097 raft_consensus.cc:482] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:50:15.086301 31097 raft_consensus.cc:504] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d15b587da424d60938ad107ab477a86" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32887 } } peers { permanent_uuid: "10556ef61a964874ac7579ff0a9e0c7c" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40579 } } peers { permanent_uuid: "eafb709a6c2043a6ae9f40aa64173d43" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42479 } }
I20260808 17:50:15.086800 31097 leader_election.cc:288] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d15b587da424d60938ad107ab477a86 (127.28.213.129:32887), 10556ef61a964874ac7579ff0a9e0c7c (127.28.213.131:40579)
I20260808 17:50:15.089566 31078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:15.087044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:41827 (local address 127.28.213.129:32887)
0808 17:50:15.087091 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:15.087092 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:15.087101 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:50:15.087163 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:15.087164 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:15.087174 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:15.087223 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:15.087429 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:15.087938 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:15.088866 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:15.089254 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:15.089306 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:15.089315 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:15.089457 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 17:50:15.089494 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 17:50:15.089577 31084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:15.087141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:36887 (local address 127.28.213.131:40579)
0808 17:50:15.087188 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:15.087190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:15.087293 (+ 103us) server_negotiation.cc:407] Connection header received
0808 17:50:15.087325 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:15.087326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:15.087334 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:15.087388 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:15.087537 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:15.087984 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:15.088877 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:15.089275 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:15.089342 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:15.089351 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:15.089478 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 17:50:15.089513 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:50:15.089582 30857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:15.086969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:32887 (local address 127.28.213.130:41827)
0808 17:50:15.087026 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:15.087039 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:15.087091 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:15.087267 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:15.087267 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:15.087269 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:15.087343 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:15.087345 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:15.088009 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:15.088010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:15.088778 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:15.088780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:15.089316 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:15.089317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:15.089393 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:15.089396 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:50:15.089439 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 17:50:15.089480 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":17}
I20260808 17:50:15.089597 31099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:15.087063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:40579 (local address 127.28.213.130:36887)
0808 17:50:15.087225 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:15.087234 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:15.087289 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:15.087398 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:15.087399 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:15.087401 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:15.087477 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:15.087478 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:15.088055 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:15.088055 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:15.088790 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:15.088791 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:15.089356 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:15.089357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:15.089408 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:15.089412 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:15.089463 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 17:50:15.089508 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":113,"threads_started":1}
I20260808 17:50:15.090006 30588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7bd8542acab4e24906c632ca6b8e161" candidate_uuid: "eafb709a6c2043a6ae9f40aa64173d43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d15b587da424d60938ad107ab477a86" is_pre_election: true
I20260808 17:50:15.090123 30990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7bd8542acab4e24906c632ca6b8e161" candidate_uuid: "eafb709a6c2043a6ae9f40aa64173d43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10556ef61a964874ac7579ff0a9e0c7c" is_pre_election: true
I20260808 17:50:15.090196 30588 raft_consensus.cc:2454] T b7bd8542acab4e24906c632ca6b8e161 P 7d15b587da424d60938ad107ab477a86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafb709a6c2043a6ae9f40aa64173d43 in term 0.
I20260808 17:50:15.090271 30990 raft_consensus.cc:2454] T b7bd8542acab4e24906c632ca6b8e161 P 10556ef61a964874ac7579ff0a9e0c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafb709a6c2043a6ae9f40aa64173d43 in term 0.
I20260808 17:50:15.090498 30688 leader_election.cc:302] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d15b587da424d60938ad107ab477a86, eafb709a6c2043a6ae9f40aa64173d43; no voters:
I20260808 17:50:15.090622 31097 raft_consensus.cc:2781] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:50:15.090680 31097 raft_consensus.cc:482] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:50:15.090704 31097 raft_consensus.cc:3037] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:15.091391 31097 raft_consensus.cc:504] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d15b587da424d60938ad107ab477a86" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32887 } } peers { permanent_uuid: "10556ef61a964874ac7579ff0a9e0c7c" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40579 } } peers { permanent_uuid: "eafb709a6c2043a6ae9f40aa64173d43" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42479 } }
I20260808 17:50:15.091509 31097 leader_election.cc:288] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43 [CANDIDATE]: Term 1 election: Requested vote from peers 7d15b587da424d60938ad107ab477a86 (127.28.213.129:32887), 10556ef61a964874ac7579ff0a9e0c7c (127.28.213.131:40579)
I20260808 17:50:15.091681 30990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7bd8542acab4e24906c632ca6b8e161" candidate_uuid: "eafb709a6c2043a6ae9f40aa64173d43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10556ef61a964874ac7579ff0a9e0c7c"
I20260808 17:50:15.091677 30588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7bd8542acab4e24906c632ca6b8e161" candidate_uuid: "eafb709a6c2043a6ae9f40aa64173d43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d15b587da424d60938ad107ab477a86"
I20260808 17:50:15.091759 30990 raft_consensus.cc:3037] T b7bd8542acab4e24906c632ca6b8e161 P 10556ef61a964874ac7579ff0a9e0c7c [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:15.091761 30588 raft_consensus.cc:3037] T b7bd8542acab4e24906c632ca6b8e161 P 7d15b587da424d60938ad107ab477a86 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:15.092667 30588 raft_consensus.cc:2454] T b7bd8542acab4e24906c632ca6b8e161 P 7d15b587da424d60938ad107ab477a86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafb709a6c2043a6ae9f40aa64173d43 in term 1.
I20260808 17:50:15.092686 30990 raft_consensus.cc:2454] T b7bd8542acab4e24906c632ca6b8e161 P 10556ef61a964874ac7579ff0a9e0c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafb709a6c2043a6ae9f40aa64173d43 in term 1.
I20260808 17:50:15.092815 30688 leader_election.cc:302] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10556ef61a964874ac7579ff0a9e0c7c, eafb709a6c2043a6ae9f40aa64173d43; no voters:
I20260808 17:50:15.092911 31097 raft_consensus.cc:2781] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:15.093050 31097 raft_consensus.cc:686] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43 [term 1 LEADER]: Becoming Leader. State: Replica: eafb709a6c2043a6ae9f40aa64173d43, State: Running, Role: LEADER
I20260808 17:50:15.093127 31097 consensus_queue.cc:237] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d15b587da424d60938ad107ab477a86" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32887 } } peers { permanent_uuid: "10556ef61a964874ac7579ff0a9e0c7c" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40579 } } peers { permanent_uuid: "eafb709a6c2043a6ae9f40aa64173d43" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42479 } }
I20260808 17:50:15.093964 30376 catalog_manager.cc:5495] T b7bd8542acab4e24906c632ca6b8e161 P eafb709a6c2043a6ae9f40aa64173d43 reported cstate change: term changed from 0 to 1, leader changed from <none> to eafb709a6c2043a6ae9f40aa64173d43 (127.28.213.130). New cstate: current_term: 1 leader_uuid: "eafb709a6c2043a6ae9f40aa64173d43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d15b587da424d60938ad107ab477a86" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10556ef61a964874ac7579ff0a9e0c7c" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafb709a6c2043a6ae9f40aa64173d43" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42479 } health_report { overall_health: HEALTHY } } }
Aug 08 17:50:15 dist-test-slave-bndk krb5kdc[30301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211414, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.129@KRBTEST.COM
I20260808 17:50:15.102890 31078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:15.096156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60754 (local address 127.28.213.129:32887)
0808 17:50:15.096199 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:15.096201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:15.096296 (+ 95us) server_negotiation.cc:407] Connection header received
0808 17:50:15.096358 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:15.096359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:15.096368 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:15.096425 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:15.096939 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:15.097416 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:15.098067 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:15.098254 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:15.098305 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:15.100394 (+ 2089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:15.100403 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:15.100404 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:15.100411 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:15.101872 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:15.102184 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:15.102187 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:15.102188 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:15.102238 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:15.102401 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:15.102402 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:15.102403 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:15.102532 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:15.102655 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:15.102722 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 17:50:15.102798 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
Aug 08 17:50:15 dist-test-slave-bndk krb5kdc[30301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211415, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 17:50:15 dist-test-slave-bndk krb5kdc[30301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211415, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.213.129@KRBTEST.COM
I20260808 17:50:15.126191 31078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:15.119873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60768 (local address 127.28.213.129:32887)
0808 17:50:15.119929 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:15.119931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:15.119985 (+ 54us) server_negotiation.cc:407] Connection header received
0808 17:50:15.120061 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:15.120062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:15.120071 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:15.120111 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:15.120609 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:15.121064 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:15.121786 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:15.121972 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:15.122027 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:15.123969 (+ 1942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:15.123971 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:15.123971 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:15.123978 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:15.125118 (+ 1140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:15.125455 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:15.125456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:15.125456 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:15.125508 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:15.125665 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:15.125666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:15.125667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:15.125756 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:15.125836 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:15.125994 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 17:50:15.126098 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
Aug 08 17:50:15 dist-test-slave-bndk krb5kdc[30301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211415, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 17:50:15 dist-test-slave-bndk krb5kdc[30301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211415, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.129@KRBTEST.COM
I20260808 17:50:15.146790 31078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:15.141020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60776 (local address 127.28.213.129:32887)
0808 17:50:15.141075 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:15.141077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:15.141134 (+ 57us) server_negotiation.cc:407] Connection header received
0808 17:50:15.141193 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:15.141194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:15.141204 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:15.141265 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:15.141739 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:15.142174 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:15.142825 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:15.143010 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:15.143062 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:15.144885 (+ 1823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:15.144886 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:15.144887 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:15.144893 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:15.145931 (+ 1038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:15.146242 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:15.146243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:15.146243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:15.146284 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:15.146452 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:15.146453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:15.146453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:15.146536 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:15.146604 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:15.146676 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 17:50:15.146726 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
W20260808 17:50:15.147434 30522 tablet_service.cc:2908] Rejecting scan request for tablet b7bd8542acab4e24906c632ca6b8e161: Uninitialized: clean time has not yet been initialized
I20260808 17:50:15.148260 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 30464
I20260808 17:50:15.160897 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 30658
I20260808 17:50:15.167279 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 30860
I20260808 17:50:15.182194 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 30326
2026-08-08T17:50:15Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2060 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:50:15 dist-test-slave-bndk krb5kdc[31124](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:50:15 dist-test-slave-bndk krb5kdc[31124](info): set up 2 sockets
Aug 08 17:50:15 dist-test-slave-bndk krb5kdc[31124](info): commencing operation
krb5kdc: starting...
W20260808 17:50:16.307524 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:50:16 dist-test-slave-bndk krb5kdc[31124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211416, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:50:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:50:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:50:16.415545 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:36281
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:34749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:36281
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:16.495307 31143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:16.495513 31143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:16.495543 31143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:16.496651 31143 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:16.496690 31143 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 17:50:16.496707 31143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:16.496723 31143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:16.496740 31143 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:16.496762 31143 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:50:16.498255 31143 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:34749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:36281
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:36281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:16.498510 31143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:16.498713 31143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:16.503202 31149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:16.503149 31153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:16.503162 31148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:16.503306 31143 server_base.cc:1034] running on GCE node
I20260808 17:50:16.503645 31143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:16.503891 31143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:16.505020 31143 hybrid_clock.cc:648] HybridClock initialized: now 1786211416505011 us; error 29 us; skew 500 ppm
Aug 08 17:50:16 dist-test-slave-bndk krb5kdc[31124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211416, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:16.511039 31143 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:50:16.511457 31143 webserver.cc:460] Webserver started at http://127.28.213.190:35979/ using document root <none> and password file <none>
I20260808 17:50:16.511650 31143 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:16.511696 31143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:16.511816 31143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:16.512822 31143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "aab120ec98d54ca8bb888ab16659ffba"
format_stamp: "Formatted at 2026-08-08 17:50:16 on dist-test-slave-bndk"
server_key: "59471b189f53922a5ea24b5dec022e70"
server_key_iv: "aab62cf318a077147064e256018ba828"
server_key_version: "encryptionkey@0"
I20260808 17:50:16.513237 31143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "aab120ec98d54ca8bb888ab16659ffba"
format_stamp: "Formatted at 2026-08-08 17:50:16 on dist-test-slave-bndk"
server_key: "59471b189f53922a5ea24b5dec022e70"
server_key_iv: "aab62cf318a077147064e256018ba828"
server_key_version: "encryptionkey@0"
I20260808 17:50:16.514539 31143 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:16.515177 31163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:16.515317 31143 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:16.515400 31143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "aab120ec98d54ca8bb888ab16659ffba"
format_stamp: "Formatted at 2026-08-08 17:50:16 on dist-test-slave-bndk"
server_key: "59471b189f53922a5ea24b5dec022e70"
server_key_iv: "aab62cf318a077147064e256018ba828"
server_key_version: "encryptionkey@0"
I20260808 17:50:16.515466 31143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:16.544216 31143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:16.546248 31143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:16.546383 31143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:16.550889 31143 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:36281
I20260808 17:50:16.550959 31254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:36281 every 8 connection(s)
I20260808 17:50:16.551224 31143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:50:16.551843 31257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:16.554080 31257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba: Bootstrap starting.
I20260808 17:50:16.554644 31257 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:16.554913 31257 log.cc:824] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:16.555537 31257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba: No bootstrap required, opened a new log
I20260808 17:50:16.557750 31257 raft_consensus.cc:348] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aab120ec98d54ca8bb888ab16659ffba" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36281 } }
I20260808 17:50:16.557886 31257 raft_consensus.cc:374] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:16.557931 31257 raft_consensus.cc:729] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aab120ec98d54ca8bb888ab16659ffba, State: Initialized, Role: FOLLOWER
I20260808 17:50:16.558070 31257 consensus_queue.cc:260] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aab120ec98d54ca8bb888ab16659ffba" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36281 } }
I20260808 17:50:16.558149 31257 raft_consensus.cc:388] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:50:16.558174 31257 raft_consensus.cc:482] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:50:16.558221 31257 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:16.558718 31257 raft_consensus.cc:504] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aab120ec98d54ca8bb888ab16659ffba" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36281 } }
I20260808 17:50:16.558811 31257 leader_election.cc:302] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aab120ec98d54ca8bb888ab16659ffba; no voters:
I20260808 17:50:16.558969 31257 leader_election.cc:288] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:50:16.559002 31260 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:16.559140 31260 raft_consensus.cc:686] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba [term 1 LEADER]: Becoming Leader. State: Replica: aab120ec98d54ca8bb888ab16659ffba, State: Running, Role: LEADER
I20260808 17:50:16.559211 31257 sys_catalog.cc:564] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:16.559242 31260 consensus_queue.cc:237] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aab120ec98d54ca8bb888ab16659ffba" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36281 } }
I20260808 17:50:16.559564 31265 sys_catalog.cc:455] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aab120ec98d54ca8bb888ab16659ffba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aab120ec98d54ca8bb888ab16659ffba" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36281 } } }
I20260808 17:50:16.559677 31265 sys_catalog.cc:458] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:16.559567 31266 sys_catalog.cc:455] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba [sys.catalog]: SysCatalogTable state changed. Reason: New leader aab120ec98d54ca8bb888ab16659ffba. Latest consensus state: current_term: 1 leader_uuid: "aab120ec98d54ca8bb888ab16659ffba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aab120ec98d54ca8bb888ab16659ffba" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36281 } } }
I20260808 17:50:16.559806 31266 sys_catalog.cc:458] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:16.559854 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 31143
I20260808 17:50:16.559930 31273 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:50:16.559958 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:50:16.560113 29526 external_mini_cluster.cc:1428] Setting key 736d3132b579b80074886177c628045a
I20260808 17:50:16.560441 31273 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:50:16.562139 31273 catalog_manager.cc:1347] Generated new cluster ID: 4fcaeabad1f04d66a5dadb6cd0496cf2
I20260808 17:50:16.562191 31273 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:50:16 dist-test-slave-bndk krb5kdc[31124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211416, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:16.571594 31285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:16.560717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36806 (local address 127.28.213.190:36281)
0808 17:50:16.561199 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:16.561209 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:16.561259 (+ 50us) server_negotiation.cc:407] Connection header received
0808 17:50:16.561371 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:16.561378 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:16.561432 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:16.561562 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:16.562325 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:16.563745 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:16.564760 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:16.565448 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:16.565560 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:16.568264 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:16.568269 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:16.568269 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:16.568281 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:16.570081 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:16.570466 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:16.570469 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:16.570469 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:16.570563 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:16.570751 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:16.570751 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:16.570751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:16.571018 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:16.571143 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:16.571244 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 17:50:16.571381 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":364,"thread_start_us":69,"threads_started":1}
I20260808 17:50:16.587224 31273 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:50:16.587702 31273 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:50:16.590812 31273 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba: Generated new TSK 0
I20260808 17:50:16.590996 31273 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
I20260808 17:50:16.620848 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:36281
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:34749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:16.699704 31299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:16.699957 31299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:16.699994 31299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:16.701102 31299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:16.701136 31299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:16.701154 31299 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 17:50:16.701174 31299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:50:16.702551 31299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:34749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.213.190:36281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:16.702726 31299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:16.702898 31299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:16.707371 31309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:16.707423 31308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:16.707546 31299 server_base.cc:1034] running on GCE node
W20260808 17:50:16.707620 31312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:16.707805 31299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:16.708026 31299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:16.709167 31299 hybrid_clock.cc:648] HybridClock initialized: now 1786211416709153 us; error 26 us; skew 500 ppm
Aug 08 17:50:16 dist-test-slave-bndk krb5kdc[31124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211416, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:16.711444 31299 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:50:16.711813 31299 webserver.cc:460] Webserver started at http://127.28.213.129:44761/ using document root <none> and password file <none>
I20260808 17:50:16.712015 31299 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:16.712060 31299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:16.712181 31299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:16.713187 31299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "d4ed901f4bda4b118539c06c6e86a0bb"
format_stamp: "Formatted at 2026-08-08 17:50:16 on dist-test-slave-bndk"
server_key: "1bb840992ca7700f9008f7733fb9f619"
server_key_iv: "84ff74149e066f5490e1ee9c91552986"
server_key_version: "encryptionkey@0"
I20260808 17:50:16.713558 31299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "d4ed901f4bda4b118539c06c6e86a0bb"
format_stamp: "Formatted at 2026-08-08 17:50:16 on dist-test-slave-bndk"
server_key: "1bb840992ca7700f9008f7733fb9f619"
server_key_iv: "84ff74149e066f5490e1ee9c91552986"
server_key_version: "encryptionkey@0"
I20260808 17:50:16.714720 31299 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:50:16.715370 31322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:16.715513 31299 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:16.715591 31299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "d4ed901f4bda4b118539c06c6e86a0bb"
format_stamp: "Formatted at 2026-08-08 17:50:16 on dist-test-slave-bndk"
server_key: "1bb840992ca7700f9008f7733fb9f619"
server_key_iv: "84ff74149e066f5490e1ee9c91552986"
server_key_version: "encryptionkey@0"
I20260808 17:50:16.715655 31299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:16.727272 31299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:16.728753 31299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:16.728873 31299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:16.729401 31299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:16.729444 31299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:16.729472 31299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:16.729494 31299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 17:50:16 dist-test-slave-bndk krb5kdc[31124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211416, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:16.736320 31299 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:32783
I20260808 17:50:16.736696 31299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:50:16.736711 31507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:32783 every 8 connection(s)
I20260808 17:50:16.738394 31285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:16.729836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:45273 (local address 127.28.213.190:36281)
0808 17:50:16.729886 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:16.729889 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:16.730086 (+ 197us) server_negotiation.cc:407] Connection header received
0808 17:50:16.730532 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:16.730533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:16.730545 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:16.730597 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:16.731178 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:16.731680 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:16.732635 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:16.732837 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:16.732893 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:16.735883 (+ 2990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:16.735885 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:16.735885 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:16.735893 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:16.737403 (+ 1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:16.737735 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:16.737736 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:16.737736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:16.737783 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:16.737957 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:16.737958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:16.737958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:16.738050 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:16.738093 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:16.738274 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 17:50:16.738331 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:50:16.738564 31336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:16.729839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:36281 (local address 127.28.213.129:45273)
0808 17:50:16.729980 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:16.730012 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:16.730437 (+ 425us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:16.730660 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:16.730664 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:16.730921 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:16.731091 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:16.731096 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:16.731762 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:16.731763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:16.732553 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:16.732556 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:16.732917 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:16.732918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:16.733047 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:16.733555 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:16.733565 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:16.735805 (+ 2240us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:16.737470 (+ 1665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:16.737473 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:16.737475 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:16.737677 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:16.737825 (+ 148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:16.737825 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:16.737826 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:16.737915 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:16.738090 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:16.738093 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:16.738191 (+ 98us) client_negotiation.cc:769] Sending connection context
0808 17:50:16.738260 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 17:50:16.738368 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":79,"threads_started":1}
I20260808 17:50:16.739003 31508 heartbeater.cc:347] Connected to a master server at 127.28.213.190:36281
I20260808 17:50:16.739084 31508 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:16.739238 31508 heartbeater.cc:511] Master 127.28.213.190:36281 requested a full tablet report, sending...
I20260808 17:50:16.739745 31187 ts_manager.cc:194] Registered new tserver with Master: d4ed901f4bda4b118539c06c6e86a0bb (127.28.213.129:32783)
I20260808 17:50:16.740386 31187 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:45273
I20260808 17:50:16.744565 31285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:16.739973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:49293 (local address 127.28.213.190:36281)
0808 17:50:16.740005 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:16.740007 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:16.740118 (+ 111us) server_negotiation.cc:407] Connection header received
0808 17:50:16.740171 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:16.740172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:16.740181 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:16.740222 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:16.740608 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:16.741053 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:16.741759 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:16.741959 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:16.742013 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:16.742716 (+ 703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:16.742717 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:16.742717 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:16.742723 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:16.743629 (+ 906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:16.743919 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:16.743920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:16.743921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:16.743972 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:16.744127 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:16.744128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:16.744129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:16.744225 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:16.744278 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:16.744407 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 17:50:16.744481 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 17:50:16.744570 31517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:16.739932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:36281 (local address 127.28.213.129:49293)
0808 17:50:16.740057 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:16.740067 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:16.740120 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:16.740235 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:16.740235 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:16.740411 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:16.740459 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:16.740461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:16.741138 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:16.741139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:16.741689 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:16.741691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:16.742016 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:16.742017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:16.742090 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:16.742390 (+ 300us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:16.742394 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:16.742643 (+ 249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:16.743698 (+ 1055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:16.743699 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:16.743699 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:16.743852 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:16.744024 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:16.744024 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:16.744025 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:16.744080 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:16.744277 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:16.744278 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:16.744321 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 17:50:16.744379 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 17:50:16.744480 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":74,"threads_started":1}
I20260808 17:50:16.745385 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 31299
I20260808 17:50:16.745477 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:50:16.745645 29526 external_mini_cluster.cc:1428] Setting key 31926ab3068d5a25ba22dd591593dc33
WARNING: no policy specified for kudu/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
I20260808 17:50:16.767871 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:36281
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:34749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:16.845642 31520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:16.845827 31520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:16.845849 31520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:16.846956 31520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:16.846997 31520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:16.847016 31520 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 17:50:16.847046 31520 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:50:16.848413 31520 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:34749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.213.190:36281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:16.848604 31520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:16.848793 31520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:16.853397 31525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:16.853452 31520 server_base.cc:1034] running on GCE node
W20260808 17:50:16.853413 31526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:16.853418 31528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:16.853731 31520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:16.853942 31520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:16.855074 31520 hybrid_clock.cc:648] HybridClock initialized: now 1786211416855062 us; error 24 us; skew 500 ppm
Aug 08 17:50:16 dist-test-slave-bndk krb5kdc[31124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211416, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:16.857322 31520 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:50:16.857733 31520 webserver.cc:460] Webserver started at http://127.28.213.130:37397/ using document root <none> and password file <none>
I20260808 17:50:16.857921 31520 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:16.857967 31520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:16.858089 31520 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:16.859064 31520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "a5ece77c31634b3bbcec70ba5729a4bd"
format_stamp: "Formatted at 2026-08-08 17:50:16 on dist-test-slave-bndk"
server_key: "a6df66b228c9c6c76c9f0e46ec268ab1"
server_key_iv: "f74124da81facab34f87479cfc3a499d"
server_key_version: "encryptionkey@0"
I20260808 17:50:16.859385 31520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "a5ece77c31634b3bbcec70ba5729a4bd"
format_stamp: "Formatted at 2026-08-08 17:50:16 on dist-test-slave-bndk"
server_key: "a6df66b228c9c6c76c9f0e46ec268ab1"
server_key_iv: "f74124da81facab34f87479cfc3a499d"
server_key_version: "encryptionkey@0"
I20260808 17:50:16.860616 31520 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:50:16.861297 31540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:16.861456 31520 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:16.861546 31520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "a5ece77c31634b3bbcec70ba5729a4bd"
format_stamp: "Formatted at 2026-08-08 17:50:16 on dist-test-slave-bndk"
server_key: "a6df66b228c9c6c76c9f0e46ec268ab1"
server_key_iv: "f74124da81facab34f87479cfc3a499d"
server_key_version: "encryptionkey@0"
I20260808 17:50:16.861605 31520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:16.870195 31520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:16.871794 31520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:16.871914 31520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:16.872375 31520 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:16.872422 31520 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:16.872449 31520 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:16.872470 31520 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 17:50:16 dist-test-slave-bndk krb5kdc[31124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211416, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:16.879346 31520 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:44547
I20260808 17:50:16.879421 31713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:44547 every 8 connection(s)
I20260808 17:50:16.879644 31520 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:50:16.881386 31285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:16.872715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:50047 (local address 127.28.213.190:36281)
0808 17:50:16.872762 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:16.872764 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:16.872983 (+ 219us) server_negotiation.cc:407] Connection header received
0808 17:50:16.873474 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:16.873476 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:16.873490 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:16.873559 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:16.874109 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:16.874645 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:16.875705 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:16.875986 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:16.876039 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:16.878910 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:16.878912 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:16.878912 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:16.878920 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:16.880351 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:16.880673 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:16.880673 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:16.880674 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:16.880718 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:16.880896 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:16.880896 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:16.880896 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:16.880995 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:16.881040 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:16.881253 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 17:50:16.881323 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:50:16.881528 31552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:16.872713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:36281 (local address 127.28.213.130:50047)
0808 17:50:16.872857 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:16.872888 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:16.873363 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:16.873610 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:16.873613 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:16.873824 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:16.874024 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:16.874029 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:16.874796 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:16.874798 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:16.875623 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:16.875625 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:16.876065 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:16.876066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:16.876197 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:16.876653 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:16.876663 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:16.878792 (+ 2129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:16.880416 (+ 1624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:16.880420 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:16.880422 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:16.880617 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:16.880759 (+ 142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:16.880760 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:16.880760 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:16.880842 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:16.881036 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:16.881039 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:16.881135 (+ 96us) client_negotiation.cc:769] Sending connection context
0808 17:50:16.881207 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 17:50:16.881360 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":80,"threads_started":1}
I20260808 17:50:16.881843 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 31520
I20260808 17:50:16.881945 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:50:16.882014 31714 heartbeater.cc:347] Connected to a master server at 127.28.213.190:36281
I20260808 17:50:16.882094 31714 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:16.882131 29526 external_mini_cluster.cc:1428] Setting key 8cf54c9802e3eced46b5246cc60ca09b
I20260808 17:50:16.882266 31714 heartbeater.cc:511] Master 127.28.213.190:36281 requested a full tablet report, sending...
I20260808 17:50:16.882754 31190 ts_manager.cc:194] Registered new tserver with Master: a5ece77c31634b3bbcec70ba5729a4bd (127.28.213.130:44547)
I20260808 17:50:16.883186 31190 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:50047
I20260808 17:50:16.888312 31723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:16.882970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:36281 (local address 127.28.213.130:37735)
0808 17:50:16.883096 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:16.883105 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:16.883148 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:16.883404 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:16.883405 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:16.883572 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:16.883624 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:16.883626 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:16.884216 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:16.884217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:16.884949 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:16.884951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:16.885335 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:16.885336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:16.885405 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:16.885764 (+ 359us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:16.885769 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:16.886022 (+ 253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:16.887467 (+ 1445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:16.887468 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:16.887469 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:16.887614 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:16.887791 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:16.887791 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:16.887792 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:16.887834 (+ 42us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:16.888111 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:16.888112 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:16.888143 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 17:50:16.888186 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 17:50:16.888250 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":74,"threads_started":1}
I20260808 17:50:16.888360 31285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:16.883033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:37735 (local address 127.28.213.190:36281)
0808 17:50:16.883298 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:16.883300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:16.883309 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:50:16.883327 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:16.883328 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:16.883336 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:16.883388 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:16.883694 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:16.884136 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:16.885041 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:16.885271 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:16.885329 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:16.886102 (+ 773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:16.886104 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:16.886104 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:16.886111 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:16.887384 (+ 1273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:16.887679 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:16.887680 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:16.887681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:16.887737 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:16.887871 (+ 134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:16.887871 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:16.887872 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:16.888055 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:16.888124 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:16.888213 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 17:50:16.888279 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246}
WARNING: no policy specified for kudu/127.28.213.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
I20260808 17:50:16.905392 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:36281
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:34749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:16.982940 31726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:16.983121 31726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:16.983143 31726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:16.984238 31726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:16.984277 31726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:16.984297 31726 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 17:50:16.984314 31726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:50:16.985662 31726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:34749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.213.190:36281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:16.985831 31726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:16.985996 31726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:16.990487 31738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:16.990525 31737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:16.990609 31726 server_base.cc:1034] running on GCE node
W20260808 17:50:16.990525 31740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:16.990852 31726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:16.991080 31726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:16.992204 31726 hybrid_clock.cc:648] HybridClock initialized: now 1786211416992196 us; error 26 us; skew 500 ppm
Aug 08 17:50:16 dist-test-slave-bndk krb5kdc[31124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211416, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:16.994451 31726 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:50:16.994854 31726 webserver.cc:460] Webserver started at http://127.28.213.131:33455/ using document root <none> and password file <none>
I20260808 17:50:16.995043 31726 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:16.995085 31726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:16.995203 31726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:16.996206 31726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "e07763f7f0bf4507affc4fded5686088"
format_stamp: "Formatted at 2026-08-08 17:50:16 on dist-test-slave-bndk"
server_key: "c6271cf98a16ef30b3622b75681299e0"
server_key_iv: "3b5cfdb9a1d7cdbb7a1dc9fec751d6d9"
server_key_version: "encryptionkey@0"
I20260808 17:50:16.996521 31726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "e07763f7f0bf4507affc4fded5686088"
format_stamp: "Formatted at 2026-08-08 17:50:16 on dist-test-slave-bndk"
server_key: "c6271cf98a16ef30b3622b75681299e0"
server_key_iv: "3b5cfdb9a1d7cdbb7a1dc9fec751d6d9"
server_key_version: "encryptionkey@0"
I20260808 17:50:16.997749 31726 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:50:16.998369 31752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:16.998502 31726 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:16.998582 31726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "e07763f7f0bf4507affc4fded5686088"
format_stamp: "Formatted at 2026-08-08 17:50:16 on dist-test-slave-bndk"
server_key: "c6271cf98a16ef30b3622b75681299e0"
server_key_iv: "3b5cfdb9a1d7cdbb7a1dc9fec751d6d9"
server_key_version: "encryptionkey@0"
I20260808 17:50:16.998639 31726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:17.012682 31726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:17.014359 31726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:17.014487 31726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:17.014959 31726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:17.014998 31726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:17.015025 31726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:17.015055 31726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 17:50:17 dist-test-slave-bndk krb5kdc[31124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211416, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:17.022027 31726 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:34245
I20260808 17:50:17.022087 31923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:34245 every 8 connection(s)
I20260808 17:50:17.022408 31726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:50:17.024027 31285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.015300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:36107 (local address 127.28.213.190:36281)
0808 17:50:17.015339 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:17.015342 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:17.015564 (+ 222us) server_negotiation.cc:407] Connection header received
0808 17:50:17.016062 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:17.016063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:17.016078 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:17.016151 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:17.016722 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.017502 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.018714 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.019002 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.019092 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.021553 (+ 2461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:17.021554 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:17.021554 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:17.021562 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:17.022956 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:17.023336 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:17.023337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:17.023338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:17.023392 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:17.023578 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:17.023578 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:17.023578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:17.023671 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:17.023715 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:17.023901 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 17:50:17.023966 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 17:50:17.024178 31768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.015299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:36281 (local address 127.28.213.131:36107)
0808 17:50:17.015444 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:17.015476 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:17.015967 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:17.016215 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:17.016219 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:17.016477 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:17.016651 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.016656 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.017606 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.017607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.018648 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.018651 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.019195 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.019196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.019344 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.019895 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:17.019905 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:17.021479 (+ 1574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:17.023035 (+ 1556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:17.023039 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:17.023041 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:17.023279 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:17.023447 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:17.023447 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:17.023448 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:17.023537 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:17.023711 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:17.023714 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:17.023811 (+ 97us) client_negotiation.cc:769] Sending connection context
0808 17:50:17.023880 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 17:50:17.023994 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":75,"threads_started":1}
I20260808 17:50:17.024613 31925 heartbeater.cc:347] Connected to a master server at 127.28.213.190:36281
I20260808 17:50:17.024693 31925 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:17.024863 31925 heartbeater.cc:511] Master 127.28.213.190:36281 requested a full tablet report, sending...
I20260808 17:50:17.025229 31187 ts_manager.cc:194] Registered new tserver with Master: e07763f7f0bf4507affc4fded5686088 (127.28.213.131:34245)
I20260808 17:50:17.025667 31187 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:36107
I20260808 17:50:17.029407 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 31726
I20260808 17:50:17.029502 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:50:17.029663 29526 external_mini_cluster.cc:1428] Setting key ec0d36d3a03cc51a9948015f4238b3ca
I20260808 17:50:17.030443 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:50:17.030455 31285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.025667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:57053 (local address 127.28.213.190:36281)
0808 17:50:17.025704 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:17.025705 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:17.025874 (+ 169us) server_negotiation.cc:407] Connection header received
0808 17:50:17.025918 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:17.025919 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:17.025928 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:17.025968 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:17.026260 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.026698 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.027339 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.027519 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.027569 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.028317 (+ 748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:17.028318 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:17.028318 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:17.028324 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:17.029389 (+ 1065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:17.029720 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:17.029721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:17.029721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:17.029780 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:17.029973 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:17.029973 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:17.029974 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:17.030092 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:17.030156 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:17.030291 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 17:50:17.030367 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 17:50:17.030467 31936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.025615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:36281 (local address 127.28.213.131:57053)
0808 17:50:17.025750 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:17.025760 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:17.025872 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:17.025982 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:17.025983 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:17.026143 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:17.026196 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.026197 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.026780 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.026781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.027271 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.027272 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.027575 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.027576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.027637 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.027981 (+ 344us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:17.027985 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:17.028239 (+ 254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:17.029458 (+ 1219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:17.029459 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:17.029460 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:17.029652 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:17.029841 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:17.029842 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:17.029843 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:17.029917 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:17.030153 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:17.030154 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:17.030199 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 17:50:17.030269 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 17:50:17.030367 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":83,"threads_started":1}
Aug 08 17:50:17 dist-test-slave-bndk krb5kdc[31124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211417, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 17:50:17 dist-test-slave-bndk krb5kdc[31124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211417, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:17.051777 31285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.046083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40740 (local address 127.28.213.190:36281)
0808 17:50:17.046126 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:17.046127 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:17.046154 (+ 27us) server_negotiation.cc:407] Connection header received
0808 17:50:17.046216 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:17.046216 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:17.046224 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:17.046260 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:17.046736 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.047204 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.047836 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.048010 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.048052 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.049955 (+ 1903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:17.049956 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:17.049956 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:17.049962 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:17.050990 (+ 1028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:17.051284 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:17.051284 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:17.051285 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:17.051325 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:17.051454 (+ 129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:17.051455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:17.051455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:17.051539 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:17.051604 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:17.051671 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 17:50:17.051722 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:50:17.053102 31187 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40740:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:50:17.054649 31187 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:50:17.060675 31951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.056796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49726 (local address 127.28.213.130:44547)
0808 17:50:17.056973 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:17.056976 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:17.057040 (+ 64us) server_negotiation.cc:407] Connection header received
0808 17:50:17.057086 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:17.057089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:17.057105 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:17.057175 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:17.057383 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.058191 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.059585 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.060277 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.060376 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.060441 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:17.060544 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 17:50:17.060578 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":82,"threads_started":1}
I20260808 17:50:17.060675 31947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.056606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:44547 (local address 127.0.0.1:49726)
0808 17:50:17.056964 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:17.056972 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:17.057015 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:17.057262 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:17.057263 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:17.057265 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:17.057309 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.057311 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.058269 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.058270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.059494 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.059498 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.060375 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.060377 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.060452 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.060466 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 17:50:17.060525 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:50:17.060575 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"mutex_wait_us":2,"spinlock_wait_cycles":768,"thread_start_us":56,"threads_started":1}
I20260808 17:50:17.060855 31952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.056808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54974 (local address 127.28.213.131:34245)
0808 17:50:17.056966 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:17.056971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:17.057088 (+ 117us) server_negotiation.cc:407] Connection header received
0808 17:50:17.057154 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:17.057157 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:17.057169 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:17.057259 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:17.057400 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.058467 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.059500 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.060295 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.060365 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.060417 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:17.060715 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 17:50:17.060753 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":77,"threads_started":1}
I20260808 17:50:17.060881 31949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.056627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:34245 (local address 127.0.0.1:54974)
0808 17:50:17.057017 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:17.057028 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:17.057093 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:17.057311 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:17.057312 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:17.057313 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:17.057341 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.057342 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.058566 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.058567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.059415 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.059419 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.060455 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.060456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.060527 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.060532 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:50:17.060581 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 17:50:17.060621 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"mutex_wait_us":20,"thread_start_us":63,"threads_started":1}
I20260808 17:50:17.061417 31948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.056606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:32783 (local address 127.0.0.1:56598)
0808 17:50:17.056778 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:17.056813 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:17.056875 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:17.057199 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:17.057201 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:17.057203 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:17.057282 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.057284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.058556 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.058557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.059687 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.059690 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.060692 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.060693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.061249 (+ 556us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.061255 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 17:50:17.061307 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 17:50:17.061353 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":39,"thread_start_us":62,"threads_started":1}
I20260808 17:50:17.061429 31623 tablet_service.cc:1467] Processing CreateTablet for tablet ca069bb0ab3348d68f70b2bcc8edd985 (DEFAULT_TABLE table=test-table [id=0c353bf2bd904d468a251608dfda19c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:17.061708 31623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca069bb0ab3348d68f70b2bcc8edd985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:17.061592 31816 tablet_service.cc:1467] Processing CreateTablet for tablet ca069bb0ab3348d68f70b2bcc8edd985 (DEFAULT_TABLE table=test-table [id=0c353bf2bd904d468a251608dfda19c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:17.061956 31816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca069bb0ab3348d68f70b2bcc8edd985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:17.062248 31950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.056789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56598 (local address 127.28.213.129:32783)
0808 17:50:17.057051 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:17.057054 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:17.057063 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:50:17.057103 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:17.057105 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:17.057120 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:17.057195 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:17.057347 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.058477 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.059762 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.060554 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.060613 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.060659 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:17.062114 (+ 1455us) server_negotiation.cc:299] Negotiation successful
0808 17:50:17.062154 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":90,"threads_started":1}
I20260808 17:50:17.062922 31404 tablet_service.cc:1467] Processing CreateTablet for tablet ca069bb0ab3348d68f70b2bcc8edd985 (DEFAULT_TABLE table=test-table [id=0c353bf2bd904d468a251608dfda19c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:17.063283 31404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca069bb0ab3348d68f70b2bcc8edd985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:17.064324 31953 tablet_bootstrap.cc:492] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd: Bootstrap starting.
I20260808 17:50:17.065027 31955 tablet_bootstrap.cc:492] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088: Bootstrap starting.
I20260808 17:50:17.065151 31953 tablet_bootstrap.cc:654] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:17.065531 31953 log.cc:824] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:17.065951 31955 tablet_bootstrap.cc:654] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:17.066213 31955 log.cc:824] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:17.066336 31953 tablet_bootstrap.cc:492] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd: No bootstrap required, opened a new log
I20260808 17:50:17.066413 31953 ts_tablet_manager.cc:1397] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:50:17.066627 31958 tablet_bootstrap.cc:492] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb: Bootstrap starting.
I20260808 17:50:17.066917 31955 tablet_bootstrap.cc:492] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088: No bootstrap required, opened a new log
I20260808 17:50:17.066991 31955 ts_tablet_manager.cc:1397] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:50:17.067368 31958 tablet_bootstrap.cc:654] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:17.067716 31958 log.cc:824] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:17.068100 31953 raft_consensus.cc:348] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.068259 31953 raft_consensus.cc:374] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:17.068302 31953 raft_consensus.cc:729] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5ece77c31634b3bbcec70ba5729a4bd, State: Initialized, Role: FOLLOWER
I20260808 17:50:17.068411 31953 consensus_queue.cc:260] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.068547 31958 tablet_bootstrap.cc:492] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb: No bootstrap required, opened a new log
I20260808 17:50:17.068620 31958 ts_tablet_manager.cc:1397] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:50:17.068660 31953 ts_tablet_manager.cc:1428] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:50:17.068791 31714 heartbeater.cc:503] Master 127.28.213.190:36281 was elected leader, sending a full tablet report...
I20260808 17:50:17.068832 31955 raft_consensus.cc:348] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.069002 31955 raft_consensus.cc:374] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:17.069046 31955 raft_consensus.cc:729] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07763f7f0bf4507affc4fded5686088, State: Initialized, Role: FOLLOWER
I20260808 17:50:17.069160 31955 consensus_queue.cc:260] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.069434 31955 ts_tablet_manager.cc:1428] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:50:17.069514 31925 heartbeater.cc:503] Master 127.28.213.190:36281 was elected leader, sending a full tablet report...
I20260808 17:50:17.070480 31958 raft_consensus.cc:348] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.070605 31958 raft_consensus.cc:374] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:17.070633 31958 raft_consensus.cc:729] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4ed901f4bda4b118539c06c6e86a0bb, State: Initialized, Role: FOLLOWER
I20260808 17:50:17.070708 31958 consensus_queue.cc:260] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.070884 31958 ts_tablet_manager.cc:1428] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:50:17.070940 31508 heartbeater.cc:503] Master 127.28.213.190:36281 was elected leader, sending a full tablet report...
W20260808 17:50:17.130200 31715 tablet.cc:2369] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:50:17.182722 31963 raft_consensus.cc:482] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:50:17.182852 31963 raft_consensus.cc:504] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.183208 31963 leader_election.cc:288] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4ed901f4bda4b118539c06c6e86a0bb (127.28.213.129:32783), a5ece77c31634b3bbcec70ba5729a4bd (127.28.213.130:44547)
I20260808 17:50:17.186841 31951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.183512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:51261 (local address 127.28.213.130:44547)
0808 17:50:17.183557 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:17.183559 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:17.183568 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:50:17.183596 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:17.183597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:17.183605 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:17.183663 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:17.183809 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.184554 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.185940 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.186494 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.186554 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.186563 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:17.186731 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 17:50:17.186768 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:50:17.186841 31950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.183492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:54855 (local address 127.28.213.129:32783)
0808 17:50:17.183536 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:17.183537 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:17.183676 (+ 139us) server_negotiation.cc:407] Connection header received
0808 17:50:17.183728 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:17.183729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:17.183737 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:17.183784 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:17.183914 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.184600 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.185939 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.186486 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.186556 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.186563 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:17.186731 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 17:50:17.186768 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:50:17.186859 31768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.183381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:44547 (local address 127.28.213.131:51261)
0808 17:50:17.183467 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:17.183481 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:17.183532 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:17.183679 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:17.183680 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:17.183681 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:17.183745 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.183748 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.184625 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.184625 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.185858 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.185862 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.186562 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.186563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.186670 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.186672 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:50:17.186718 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 17:50:17.186767 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":22}
I20260808 17:50:17.186865 31967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.183418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:32783 (local address 127.28.213.131:54855)
0808 17:50:17.183606 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:17.183614 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:17.183671 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:17.183797 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:17.183798 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:17.183800 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:17.183861 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.183862 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.184660 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.184661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.185860 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.185862 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.186562 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.186563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.186661 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.186665 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:17.186718 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 17:50:17.186767 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":25,"thread_start_us":113,"threads_started":1}
I20260808 17:50:17.187261 31655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca069bb0ab3348d68f70b2bcc8edd985" candidate_uuid: "e07763f7f0bf4507affc4fded5686088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" is_pre_election: true
I20260808 17:50:17.187443 31655 raft_consensus.cc:2454] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e07763f7f0bf4507affc4fded5686088 in term 0.
I20260808 17:50:17.187407 31438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca069bb0ab3348d68f70b2bcc8edd985" candidate_uuid: "e07763f7f0bf4507affc4fded5686088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" is_pre_election: true
I20260808 17:50:17.187536 31438 raft_consensus.cc:2454] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e07763f7f0bf4507affc4fded5686088 in term 0.
I20260808 17:50:17.187682 31756 leader_election.cc:302] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5ece77c31634b3bbcec70ba5729a4bd, e07763f7f0bf4507affc4fded5686088; no voters:
I20260808 17:50:17.187816 31963 raft_consensus.cc:2781] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:50:17.187884 31963 raft_consensus.cc:482] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:50:17.187901 31963 raft_consensus.cc:3037] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:17.188812 31963 raft_consensus.cc:504] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.188941 31963 leader_election.cc:288] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [CANDIDATE]: Term 1 election: Requested vote from peers d4ed901f4bda4b118539c06c6e86a0bb (127.28.213.129:32783), a5ece77c31634b3bbcec70ba5729a4bd (127.28.213.130:44547)
I20260808 17:50:17.189088 31438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca069bb0ab3348d68f70b2bcc8edd985" candidate_uuid: "e07763f7f0bf4507affc4fded5686088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4ed901f4bda4b118539c06c6e86a0bb"
I20260808 17:50:17.189133 31655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca069bb0ab3348d68f70b2bcc8edd985" candidate_uuid: "e07763f7f0bf4507affc4fded5686088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5ece77c31634b3bbcec70ba5729a4bd"
I20260808 17:50:17.189174 31438 raft_consensus.cc:3037] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:17.189195 31655 raft_consensus.cc:3037] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:17.190061 31655 raft_consensus.cc:2454] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07763f7f0bf4507affc4fded5686088 in term 1.
I20260808 17:50:17.190068 31438 raft_consensus.cc:2454] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07763f7f0bf4507affc4fded5686088 in term 1.
I20260808 17:50:17.190256 31753 leader_election.cc:302] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d4ed901f4bda4b118539c06c6e86a0bb, e07763f7f0bf4507affc4fded5686088; no voters:
I20260808 17:50:17.190341 31963 raft_consensus.cc:2781] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:17.190513 31963 raft_consensus.cc:686] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [term 1 LEADER]: Becoming Leader. State: Replica: e07763f7f0bf4507affc4fded5686088, State: Running, Role: LEADER
I20260808 17:50:17.190603 31963 consensus_queue.cc:237] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.191491 31190 catalog_manager.cc:5495] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 reported cstate change: term changed from 0 to 1, leader changed from <none> to e07763f7f0bf4507affc4fded5686088 (127.28.213.131). New cstate: current_term: 1 leader_uuid: "e07763f7f0bf4507affc4fded5686088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } health_report { overall_health: HEALTHY } } }
I20260808 17:50:17.206089 31952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.203753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54990 (local address 127.28.213.131:34245)
0808 17:50:17.203796 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:17.203799 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:17.203830 (+ 31us) server_negotiation.cc:407] Connection header received
0808 17:50:17.203918 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:17.203919 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:17.203937 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:17.203988 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:17.204106 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.204557 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.205348 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.205536 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.205591 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.205779 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:17.205868 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:17.205935 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:17.205982 (+ 47us) server_negotiation.cc:299] Negotiation successful
0808 17:50:17.206002 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:50:17.207717 31655 raft_consensus.cc:1261] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd [term 1 FOLLOWER]: Refusing update from remote peer e07763f7f0bf4507affc4fded5686088: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:17.208060 31963 consensus_queue.cc:1035] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:17.209841 31438 raft_consensus.cc:1261] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb [term 1 FOLLOWER]: Refusing update from remote peer e07763f7f0bf4507affc4fded5686088: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:17.210080 31963 consensus_queue.cc:1035] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:17.214277 31187 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:17.214383 31187 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:17.215137 31187 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba: Sending DeleteTablet for 3 replicas of tablet ca069bb0ab3348d68f70b2bcc8edd985
I20260808 17:50:17.215579 31816 tablet_service.cc:1514] Processing DeleteTablet for tablet ca069bb0ab3348d68f70b2bcc8edd985 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:17 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:54974
I20260808 17:50:17.215598 31623 tablet_service.cc:1514] Processing DeleteTablet for tablet ca069bb0ab3348d68f70b2bcc8edd985 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:17 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:49726
I20260808 17:50:17.215796 31404 tablet_service.cc:1514] Processing DeleteTablet for tablet ca069bb0ab3348d68f70b2bcc8edd985 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:17 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:56598
I20260808 17:50:17.215924 31187 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40740:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:50:17.216061 31187 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:50:17.216164 31988 tablet_replica.cc:330] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd: stopping tablet replica
I20260808 17:50:17.216248 31993 tablet_replica.cc:330] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb: stopping tablet replica
I20260808 17:50:17.216360 31993 raft_consensus.cc:2229] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:17.216460 31988 raft_consensus.cc:2229] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:17.216813 31988 raft_consensus.cc:2258] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:17.217281 31404 tablet_service.cc:1467] Processing CreateTablet for tablet 545b7c2824434d0ab4bd519812b1edd9 (DEFAULT_TABLE table=test-table [id=6fcce3aa4fcc4b2ab1911eecd7b3e464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:17.217335 31816 tablet_service.cc:1467] Processing CreateTablet for tablet 545b7c2824434d0ab4bd519812b1edd9 (DEFAULT_TABLE table=test-table [id=6fcce3aa4fcc4b2ab1911eecd7b3e464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:17.217422 31404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 545b7c2824434d0ab4bd519812b1edd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:17.217429 31623 tablet_service.cc:1467] Processing CreateTablet for tablet 545b7c2824434d0ab4bd519812b1edd9 (DEFAULT_TABLE table=test-table [id=6fcce3aa4fcc4b2ab1911eecd7b3e464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:17.217468 31816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 545b7c2824434d0ab4bd519812b1edd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:17.217525 31623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 545b7c2824434d0ab4bd519812b1edd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:17.218833 31958 tablet_bootstrap.cc:492] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb: Bootstrap starting.
I20260808 17:50:17.218830 31955 tablet_bootstrap.cc:492] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088: Bootstrap starting.
I20260808 17:50:17.218844 31988 ts_tablet_manager.cc:1905] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:17.219257 31955 tablet_bootstrap.cc:654] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:17.219452 31958 tablet_bootstrap.cc:654] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:17.219761 31953 tablet_bootstrap.cc:492] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd: Bootstrap starting.
I20260808 17:50:17.220131 31953 tablet_bootstrap.cc:654] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:17.220296 31988 ts_tablet_manager.cc:1918] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:50:17.220376 31988 log.cc:1196] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/ca069bb0ab3348d68f70b2bcc8edd985
I20260808 17:50:17.220659 31988 ts_tablet_manager.cc:1939] T ca069bb0ab3348d68f70b2bcc8edd985 P a5ece77c31634b3bbcec70ba5729a4bd: Deleting consensus metadata
I20260808 17:50:17.220878 31987 tablet_replica.cc:330] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088: stopping tablet replica
I20260808 17:50:17.221027 31167 catalog_manager.cc:4841] TS a5ece77c31634b3bbcec70ba5729a4bd (127.28.213.130:44547): tablet ca069bb0ab3348d68f70b2bcc8edd985 (table test-table [id=0c353bf2bd904d468a251608dfda19c3]) successfully deleted
I20260808 17:50:17.221063 31987 raft_consensus.cc:2229] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:50:17.221190 31987 raft_consensus.cc:2258] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:17.221356 31993 raft_consensus.cc:2258] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:17.221632 31953 tablet_bootstrap.cc:492] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd: No bootstrap required, opened a new log
I20260808 17:50:17.221683 31953 ts_tablet_manager.cc:1397] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:50:17.221829 31993 ts_tablet_manager.cc:1905] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:17.221825 31953 raft_consensus.cc:348] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.221881 31953 raft_consensus.cc:374] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:17.221907 31953 raft_consensus.cc:729] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5ece77c31634b3bbcec70ba5729a4bd, State: Initialized, Role: FOLLOWER
I20260808 17:50:17.221951 31953 consensus_queue.cc:260] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.222035 31953 ts_tablet_manager.cc:1428] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:17.222388 31987 ts_tablet_manager.cc:1905] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:17.223248 31993 ts_tablet_manager.cc:1918] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:50:17.223322 31993 log.cc:1196] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-0/wal/wals/ca069bb0ab3348d68f70b2bcc8edd985
I20260808 17:50:17.223600 31993 ts_tablet_manager.cc:1939] T ca069bb0ab3348d68f70b2bcc8edd985 P d4ed901f4bda4b118539c06c6e86a0bb: Deleting consensus metadata
I20260808 17:50:17.223793 31987 ts_tablet_manager.cc:1918] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:50:17.223855 31987 log.cc:1196] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/ca069bb0ab3348d68f70b2bcc8edd985
I20260808 17:50:17.223976 31166 catalog_manager.cc:4841] TS d4ed901f4bda4b118539c06c6e86a0bb (127.28.213.129:32783): tablet ca069bb0ab3348d68f70b2bcc8edd985 (table test-table [id=0c353bf2bd904d468a251608dfda19c3]) successfully deleted
I20260808 17:50:17.224109 31987 ts_tablet_manager.cc:1939] T ca069bb0ab3348d68f70b2bcc8edd985 P e07763f7f0bf4507affc4fded5686088: Deleting consensus metadata
I20260808 17:50:17.224268 31958 tablet_bootstrap.cc:492] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb: No bootstrap required, opened a new log
I20260808 17:50:17.224308 31958 ts_tablet_manager.cc:1397] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260808 17:50:17.224455 31174 catalog_manager.cc:4841] TS e07763f7f0bf4507affc4fded5686088 (127.28.213.131:34245): tablet ca069bb0ab3348d68f70b2bcc8edd985 (table test-table [id=0c353bf2bd904d468a251608dfda19c3]) successfully deleted
I20260808 17:50:17.224455 31958 raft_consensus.cc:348] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.224517 31958 raft_consensus.cc:374] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:17.224511 31955 tablet_bootstrap.cc:492] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088: No bootstrap required, opened a new log
I20260808 17:50:17.224541 31958 raft_consensus.cc:729] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4ed901f4bda4b118539c06c6e86a0bb, State: Initialized, Role: FOLLOWER
I20260808 17:50:17.224556 31955 ts_tablet_manager.cc:1397] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260808 17:50:17.224586 31958 consensus_queue.cc:260] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.224665 31958 ts_tablet_manager.cc:1428] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:17.224697 31955 raft_consensus.cc:348] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.224762 31955 raft_consensus.cc:374] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:17.224781 31955 raft_consensus.cc:729] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07763f7f0bf4507affc4fded5686088, State: Initialized, Role: FOLLOWER
I20260808 17:50:17.224817 31955 consensus_queue.cc:260] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.224895 31955 ts_tablet_manager.cc:1428] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260808 17:50:17.237349 31509 tablet.cc:2369] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:50:17.272866 31927 tablet.cc:2369] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:50:17.513727 31963 raft_consensus.cc:482] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:50:17.513820 31963 raft_consensus.cc:504] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.513985 31963 leader_election.cc:288] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4ed901f4bda4b118539c06c6e86a0bb (127.28.213.129:32783), a5ece77c31634b3bbcec70ba5729a4bd (127.28.213.130:44547)
I20260808 17:50:17.514230 31438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545b7c2824434d0ab4bd519812b1edd9" candidate_uuid: "e07763f7f0bf4507affc4fded5686088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" is_pre_election: true
I20260808 17:50:17.514248 31655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545b7c2824434d0ab4bd519812b1edd9" candidate_uuid: "e07763f7f0bf4507affc4fded5686088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" is_pre_election: true
I20260808 17:50:17.514335 31655 raft_consensus.cc:2454] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e07763f7f0bf4507affc4fded5686088 in term 0.
I20260808 17:50:17.514339 31438 raft_consensus.cc:2454] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e07763f7f0bf4507affc4fded5686088 in term 0.
I20260808 17:50:17.514472 31756 leader_election.cc:302] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5ece77c31634b3bbcec70ba5729a4bd, e07763f7f0bf4507affc4fded5686088; no voters:
I20260808 17:50:17.514601 31963 raft_consensus.cc:2781] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:50:17.514657 31963 raft_consensus.cc:482] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:50:17.514673 31963 raft_consensus.cc:3037] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:17.515298 31963 raft_consensus.cc:504] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.515421 31963 leader_election.cc:288] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [CANDIDATE]: Term 1 election: Requested vote from peers d4ed901f4bda4b118539c06c6e86a0bb (127.28.213.129:32783), a5ece77c31634b3bbcec70ba5729a4bd (127.28.213.130:44547)
I20260808 17:50:17.515571 31438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545b7c2824434d0ab4bd519812b1edd9" candidate_uuid: "e07763f7f0bf4507affc4fded5686088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4ed901f4bda4b118539c06c6e86a0bb"
I20260808 17:50:17.515604 31655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "545b7c2824434d0ab4bd519812b1edd9" candidate_uuid: "e07763f7f0bf4507affc4fded5686088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5ece77c31634b3bbcec70ba5729a4bd"
I20260808 17:50:17.515658 31438 raft_consensus.cc:3037] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:17.515671 31655 raft_consensus.cc:3037] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:17.516390 31655 raft_consensus.cc:2454] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07763f7f0bf4507affc4fded5686088 in term 1.
I20260808 17:50:17.516390 31438 raft_consensus.cc:2454] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07763f7f0bf4507affc4fded5686088 in term 1.
I20260808 17:50:17.516618 31756 leader_election.cc:302] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5ece77c31634b3bbcec70ba5729a4bd, e07763f7f0bf4507affc4fded5686088; no voters:
I20260808 17:50:17.516776 31963 raft_consensus.cc:2781] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:17.516846 31963 raft_consensus.cc:686] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [term 1 LEADER]: Becoming Leader. State: Replica: e07763f7f0bf4507affc4fded5686088, State: Running, Role: LEADER
I20260808 17:50:17.516898 31963 consensus_queue.cc:237] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.517503 31187 catalog_manager.cc:5495] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 reported cstate change: term changed from 0 to 1, leader changed from <none> to e07763f7f0bf4507affc4fded5686088 (127.28.213.131). New cstate: current_term: 1 leader_uuid: "e07763f7f0bf4507affc4fded5686088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } health_report { overall_health: HEALTHY } } }
Aug 08 17:50:17 dist-test-slave-bndk krb5kdc[31124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211416, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:17.595978 32009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.589782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:36281 (local address 127.0.0.1:40744)
0808 17:50:17.589943 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:17.589956 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:17.590022 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:17.590164 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:17.590165 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:17.590488 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:17.590540 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.590543 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.591174 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.591175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.591702 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.591703 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.592018 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.592019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.592066 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.592510 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:17.592514 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:17.593865 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:17.595104 (+ 1239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:17.595111 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:17.595113 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:17.595304 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:17.595461 (+ 157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:17.595461 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:17.595462 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:17.595516 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:17.595704 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:17.595710 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:17.595756 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 17:50:17.595808 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 17:50:17.595902 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":85,"threads_started":1}
I20260808 17:50:17.596058 32010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.589858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40744 (local address 127.28.213.190:36281)
0808 17:50:17.589993 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:17.589995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:17.590003 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:17.590089 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:17.590090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:17.590099 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:17.590151 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:17.590618 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.591105 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.591772 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.591960 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.592013 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.593945 (+ 1932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:17.593946 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:17.593946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:17.593953 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:17.595039 (+ 1086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:17.595360 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:17.595361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:17.595361 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:17.595413 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:17.595564 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:17.595565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:17.595565 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:17.595660 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:17.595704 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:17.595832 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 17:50:17.595957 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":113,"thread_start_us":85,"threads_started":1}
I20260808 17:50:17.597867 31187 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:40744:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 17:50:17.598146 31187 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:50:17.599526 31816 tablet_service.cc:1467] Processing CreateTablet for tablet 55b8139b3f264366a27dd2d335bc1717 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6bc41c94a8ec400497a40a648d4417b4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 17:50:17.599529 31404 tablet_service.cc:1467] Processing CreateTablet for tablet 55b8139b3f264366a27dd2d335bc1717 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6bc41c94a8ec400497a40a648d4417b4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 17:50:17.599728 31404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55b8139b3f264366a27dd2d335bc1717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:17.599728 31816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55b8139b3f264366a27dd2d335bc1717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:17.600944 31958 tablet_bootstrap.cc:492] T 55b8139b3f264366a27dd2d335bc1717 P d4ed901f4bda4b118539c06c6e86a0bb: Bootstrap starting.
I20260808 17:50:17.600955 31955 tablet_bootstrap.cc:492] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088: Bootstrap starting.
I20260808 17:50:17.601023 31623 tablet_service.cc:1467] Processing CreateTablet for tablet 55b8139b3f264366a27dd2d335bc1717 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6bc41c94a8ec400497a40a648d4417b4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 17:50:17.601172 31623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55b8139b3f264366a27dd2d335bc1717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:17.601370 31955 tablet_bootstrap.cc:654] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:17.601370 31958 tablet_bootstrap.cc:654] T 55b8139b3f264366a27dd2d335bc1717 P d4ed901f4bda4b118539c06c6e86a0bb: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:17.601943 31955 tablet_bootstrap.cc:492] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088: No bootstrap required, opened a new log
I20260808 17:50:17.601995 31955 ts_tablet_manager.cc:1397] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:17.602079 31958 tablet_bootstrap.cc:492] T 55b8139b3f264366a27dd2d335bc1717 P d4ed901f4bda4b118539c06c6e86a0bb: No bootstrap required, opened a new log
I20260808 17:50:17.602133 31958 ts_tablet_manager.cc:1397] T 55b8139b3f264366a27dd2d335bc1717 P d4ed901f4bda4b118539c06c6e86a0bb: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:17.602108 31955 raft_consensus.cc:348] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.602173 31955 raft_consensus.cc:374] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:17.602197 31955 raft_consensus.cc:729] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07763f7f0bf4507affc4fded5686088, State: Initialized, Role: FOLLOWER
I20260808 17:50:17.602234 31955 consensus_queue.cc:260] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.602322 31955 ts_tablet_manager.cc:1428] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:17.602285 31958 raft_consensus.cc:348] T 55b8139b3f264366a27dd2d335bc1717 P d4ed901f4bda4b118539c06c6e86a0bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.602355 31958 raft_consensus.cc:374] T 55b8139b3f264366a27dd2d335bc1717 P d4ed901f4bda4b118539c06c6e86a0bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:17.602373 31958 raft_consensus.cc:729] T 55b8139b3f264366a27dd2d335bc1717 P d4ed901f4bda4b118539c06c6e86a0bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4ed901f4bda4b118539c06c6e86a0bb, State: Initialized, Role: FOLLOWER
I20260808 17:50:17.602398 31958 consensus_queue.cc:260] T 55b8139b3f264366a27dd2d335bc1717 P d4ed901f4bda4b118539c06c6e86a0bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.602428 31963 tablet_replica.cc:439] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } } }
I20260808 17:50:17.602496 31958 ts_tablet_manager.cc:1428] T 55b8139b3f264366a27dd2d335bc1717 P d4ed901f4bda4b118539c06c6e86a0bb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:17.602492 31963 tablet_replica.cc:442] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:17.602547 31980 tablet_replica.cc:439] T 55b8139b3f264366a27dd2d335bc1717 P d4ed901f4bda4b118539c06c6e86a0bb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } } }
I20260808 17:50:17.602591 31953 tablet_bootstrap.cc:492] T 55b8139b3f264366a27dd2d335bc1717 P a5ece77c31634b3bbcec70ba5729a4bd: Bootstrap starting.
I20260808 17:50:17.602622 31980 tablet_replica.cc:442] T 55b8139b3f264366a27dd2d335bc1717 P d4ed901f4bda4b118539c06c6e86a0bb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:17.602977 31953 tablet_bootstrap.cc:654] T 55b8139b3f264366a27dd2d335bc1717 P a5ece77c31634b3bbcec70ba5729a4bd: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:17.603533 31953 tablet_bootstrap.cc:492] T 55b8139b3f264366a27dd2d335bc1717 P a5ece77c31634b3bbcec70ba5729a4bd: No bootstrap required, opened a new log
I20260808 17:50:17.603585 31953 ts_tablet_manager.cc:1397] T 55b8139b3f264366a27dd2d335bc1717 P a5ece77c31634b3bbcec70ba5729a4bd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:17.603727 31953 raft_consensus.cc:348] T 55b8139b3f264366a27dd2d335bc1717 P a5ece77c31634b3bbcec70ba5729a4bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.603778 31953 raft_consensus.cc:374] T 55b8139b3f264366a27dd2d335bc1717 P a5ece77c31634b3bbcec70ba5729a4bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:17.603790 31953 raft_consensus.cc:729] T 55b8139b3f264366a27dd2d335bc1717 P a5ece77c31634b3bbcec70ba5729a4bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5ece77c31634b3bbcec70ba5729a4bd, State: Initialized, Role: FOLLOWER
I20260808 17:50:17.603834 31953 consensus_queue.cc:260] T 55b8139b3f264366a27dd2d335bc1717 P a5ece77c31634b3bbcec70ba5729a4bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.603919 31953 ts_tablet_manager.cc:1428] T 55b8139b3f264366a27dd2d335bc1717 P a5ece77c31634b3bbcec70ba5729a4bd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:17.603983 31961 tablet_replica.cc:439] T 55b8139b3f264366a27dd2d335bc1717 P a5ece77c31634b3bbcec70ba5729a4bd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } } }
I20260808 17:50:17.604095 31961 tablet_replica.cc:442] T 55b8139b3f264366a27dd2d335bc1717 P a5ece77c31634b3bbcec70ba5729a4bd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:17.863049 31963 raft_consensus.cc:482] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:50:17.863155 31963 raft_consensus.cc:504] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.863301 31963 leader_election.cc:288] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4ed901f4bda4b118539c06c6e86a0bb (127.28.213.129:32783), a5ece77c31634b3bbcec70ba5729a4bd (127.28.213.130:44547)
I20260808 17:50:17.863552 31438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55b8139b3f264366a27dd2d335bc1717" candidate_uuid: "e07763f7f0bf4507affc4fded5686088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" is_pre_election: true
I20260808 17:50:17.863552 31655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55b8139b3f264366a27dd2d335bc1717" candidate_uuid: "e07763f7f0bf4507affc4fded5686088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" is_pre_election: true
I20260808 17:50:17.863672 31438 raft_consensus.cc:2454] T 55b8139b3f264366a27dd2d335bc1717 P d4ed901f4bda4b118539c06c6e86a0bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e07763f7f0bf4507affc4fded5686088 in term 0.
I20260808 17:50:17.863672 31655 raft_consensus.cc:2454] T 55b8139b3f264366a27dd2d335bc1717 P a5ece77c31634b3bbcec70ba5729a4bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e07763f7f0bf4507affc4fded5686088 in term 0.
I20260808 17:50:17.863821 31756 leader_election.cc:302] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5ece77c31634b3bbcec70ba5729a4bd, e07763f7f0bf4507affc4fded5686088; no voters:
I20260808 17:50:17.863965 31963 raft_consensus.cc:2781] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:50:17.864022 31963 raft_consensus.cc:482] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:50:17.864035 31963 raft_consensus.cc:3037] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:17.864774 31963 raft_consensus.cc:504] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.864897 31963 leader_election.cc:288] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 [CANDIDATE]: Term 1 election: Requested vote from peers d4ed901f4bda4b118539c06c6e86a0bb (127.28.213.129:32783), a5ece77c31634b3bbcec70ba5729a4bd (127.28.213.130:44547)
I20260808 17:50:17.865046 31655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55b8139b3f264366a27dd2d335bc1717" candidate_uuid: "e07763f7f0bf4507affc4fded5686088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5ece77c31634b3bbcec70ba5729a4bd"
I20260808 17:50:17.865061 31438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55b8139b3f264366a27dd2d335bc1717" candidate_uuid: "e07763f7f0bf4507affc4fded5686088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4ed901f4bda4b118539c06c6e86a0bb"
I20260808 17:50:17.865125 31655 raft_consensus.cc:3037] T 55b8139b3f264366a27dd2d335bc1717 P a5ece77c31634b3bbcec70ba5729a4bd [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:17.865130 31438 raft_consensus.cc:3037] T 55b8139b3f264366a27dd2d335bc1717 P d4ed901f4bda4b118539c06c6e86a0bb [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:17.865733 31655 raft_consensus.cc:2454] T 55b8139b3f264366a27dd2d335bc1717 P a5ece77c31634b3bbcec70ba5729a4bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07763f7f0bf4507affc4fded5686088 in term 1.
I20260808 17:50:17.865782 31438 raft_consensus.cc:2454] T 55b8139b3f264366a27dd2d335bc1717 P d4ed901f4bda4b118539c06c6e86a0bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07763f7f0bf4507affc4fded5686088 in term 1.
I20260808 17:50:17.865926 31756 leader_election.cc:302] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5ece77c31634b3bbcec70ba5729a4bd, e07763f7f0bf4507affc4fded5686088; no voters:
I20260808 17:50:17.866056 31963 raft_consensus.cc:2781] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:17.866117 31963 raft_consensus.cc:686] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 [term 1 LEADER]: Becoming Leader. State: Replica: e07763f7f0bf4507affc4fded5686088, State: Running, Role: LEADER
I20260808 17:50:17.866169 31963 consensus_queue.cc:237] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } }
I20260808 17:50:17.866423 31975 tablet_replica.cc:439] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088: TxnStatusTablet state changed. Reason: New leader e07763f7f0bf4507affc4fded5686088. Latest consensus state: current_term: 1 leader_uuid: "e07763f7f0bf4507affc4fded5686088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } } }
I20260808 17:50:17.866504 31975 tablet_replica.cc:442] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088: This TxnStatusTablet replica's current role is: LEADER
I20260808 17:50:17.866650 32017 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 17:50:17.866761 32017 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 17:50:17.866784 31190 catalog_manager.cc:5495] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 reported cstate change: term changed from 0 to 1, leader changed from <none> to e07763f7f0bf4507affc4fded5686088 (127.28.213.131). New cstate: current_term: 1 leader_uuid: "e07763f7f0bf4507affc4fded5686088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } health_report { overall_health: HEALTHY } } }
I20260808 17:50:17.883600 32021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.881121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55006 (local address 127.28.213.131:34245)
0808 17:50:17.881337 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:17.881339 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:17.881345 (+ 6us) server_negotiation.cc:407] Connection header received
0808 17:50:17.881364 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:17.881364 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:17.881373 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:17.881496 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:17.881638 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.882112 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.882917 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.883135 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.883191 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.883349 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:17.883386 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:17.883439 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:17.883510 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 17:50:17.883532 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":65,"threads_started":1}
I20260808 17:50:17.883621 32009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.881074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:34245 (local address 127.0.0.1:55006)
0808 17:50:17.881164 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:17.881175 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:17.881244 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:17.881520 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:17.881522 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:17.881523 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:50:17.881575 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.881578 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.882183 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.882184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.882843 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.882846 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.883199 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.883200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.883264 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.883281 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:50:17.883449 (+ 168us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:50:17.883456 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 17:50:17.883505 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 17:50:17.883557 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 17:50:17.884670 31655 raft_consensus.cc:1261] T 55b8139b3f264366a27dd2d335bc1717 P a5ece77c31634b3bbcec70ba5729a4bd [term 1 FOLLOWER]: Refusing update from remote peer e07763f7f0bf4507affc4fded5686088: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:17.884670 31438 raft_consensus.cc:1261] T 55b8139b3f264366a27dd2d335bc1717 P d4ed901f4bda4b118539c06c6e86a0bb [term 1 FOLLOWER]: Refusing update from remote peer e07763f7f0bf4507affc4fded5686088: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:17.884893 31963 consensus_queue.cc:1035] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:17.884984 31975 consensus_queue.cc:1035] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:17.885466 31961 tablet_replica.cc:439] T 55b8139b3f264366a27dd2d335bc1717 P a5ece77c31634b3bbcec70ba5729a4bd: TxnStatusTablet state changed. Reason: New leader e07763f7f0bf4507affc4fded5686088. Latest consensus state: current_term: 1 leader_uuid: "e07763f7f0bf4507affc4fded5686088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } } }
I20260808 17:50:17.885557 31961 tablet_replica.cc:442] T 55b8139b3f264366a27dd2d335bc1717 P a5ece77c31634b3bbcec70ba5729a4bd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:17.885627 31980 tablet_replica.cc:439] T 55b8139b3f264366a27dd2d335bc1717 P d4ed901f4bda4b118539c06c6e86a0bb: TxnStatusTablet state changed. Reason: New leader e07763f7f0bf4507affc4fded5686088. Latest consensus state: current_term: 1 leader_uuid: "e07763f7f0bf4507affc4fded5686088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } } }
I20260808 17:50:17.885710 31980 tablet_replica.cc:442] T 55b8139b3f264366a27dd2d335bc1717 P d4ed901f4bda4b118539c06c6e86a0bb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:17.886198 31963 tablet_replica.cc:439] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e07763f7f0bf4507affc4fded5686088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } } }
I20260808 17:50:17.886277 31963 tablet_replica.cc:442] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088: This TxnStatusTablet replica's current role is: LEADER
I20260808 17:50:17.886441 32022 mvcc.cc:205] Tried to move back new op lower bound from 7316321967654109184 to 7316321967580143616. Current Snapshot: MvccSnapshot[applied={T|T < 7316321967654109184}]
I20260808 17:50:17.886606 31980 tablet_replica.cc:439] T 55b8139b3f264366a27dd2d335bc1717 P d4ed901f4bda4b118539c06c6e86a0bb: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e07763f7f0bf4507affc4fded5686088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } } }
I20260808 17:50:17.886688 31980 tablet_replica.cc:442] T 55b8139b3f264366a27dd2d335bc1717 P d4ed901f4bda4b118539c06c6e86a0bb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:17.889747 32027 mvcc.cc:205] Tried to move back new op lower bound from 7316321967654109184 to 7316321967580143616. Current Snapshot: MvccSnapshot[applied={T|T < 7316321967654109184}]
I20260808 17:50:17.889853 31963 tablet_replica.cc:439] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e07763f7f0bf4507affc4fded5686088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } } }
I20260808 17:50:17.889935 31963 tablet_replica.cc:442] T 55b8139b3f264366a27dd2d335bc1717 P e07763f7f0bf4507affc4fded5686088: This TxnStatusTablet replica's current role is: LEADER
I20260808 17:50:17.890389 31961 tablet_replica.cc:439] T 55b8139b3f264366a27dd2d335bc1717 P a5ece77c31634b3bbcec70ba5729a4bd: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e07763f7f0bf4507affc4fded5686088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 } } peers { permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 } } peers { permanent_uuid: "e07763f7f0bf4507affc4fded5686088" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34245 } } }
I20260808 17:50:17.890472 31961 tablet_replica.cc:442] T 55b8139b3f264366a27dd2d335bc1717 P a5ece77c31634b3bbcec70ba5729a4bd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:17.893332 32021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.890762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:44571 (local address 127.28.213.131:34245)
0808 17:50:17.890799 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:17.890801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:17.890986 (+ 185us) server_negotiation.cc:407] Connection header received
0808 17:50:17.891041 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:17.891041 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:17.891050 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:17.891090 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:17.891193 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.891640 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.892724 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.892896 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.892955 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.893108 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:17.893130 (+ 22us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:17.893163 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:17.893235 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 17:50:17.893256 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:50:17.893407 32037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.890508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:34245 (local address 127.28.213.131:44571)
0808 17:50:17.890915 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:17.890924 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:17.890987 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:17.891096 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:17.891096 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:17.891098 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:50:17.891142 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.891144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.891695 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.891696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.892660 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:17.892663 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.892959 (+ 296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.892960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:17.893025 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.893041 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:50:17.893166 (+ 125us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:50:17.893168 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:50:17.893212 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 17:50:17.893280 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":73,"threads_started":1}
I20260808 17:50:17.895169 31655 raft_consensus.cc:1261] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd [term 1 FOLLOWER]: Refusing update from remote peer e07763f7f0bf4507affc4fded5686088: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:17.895218 31438 raft_consensus.cc:1261] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb [term 1 FOLLOWER]: Refusing update from remote peer e07763f7f0bf4507affc4fded5686088: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:17.895398 32038 consensus_queue.cc:1035] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5ece77c31634b3bbcec70ba5729a4bd" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:17.895505 31963 consensus_queue.cc:1035] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4ed901f4bda4b118539c06c6e86a0bb" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:17.897483 32023 mvcc.cc:205] Tried to move back new op lower bound from 7316321967697428480 to 7316321966149693440. Current Snapshot: MvccSnapshot[applied={T|T < 7316321967697428480}]
I20260808 17:50:17.906754 31187 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:17.906831 31187 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:17.907404 31187 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aab120ec98d54ca8bb888ab16659ffba: Sending DeleteTablet for 3 replicas of tablet 545b7c2824434d0ab4bd519812b1edd9
I20260808 17:50:17.907675 31623 tablet_service.cc:1514] Processing DeleteTablet for tablet 545b7c2824434d0ab4bd519812b1edd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:17 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:49726
I20260808 17:50:17.907689 31404 tablet_service.cc:1514] Processing DeleteTablet for tablet 545b7c2824434d0ab4bd519812b1edd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:17 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:56598
I20260808 17:50:17.907846 31816 tablet_service.cc:1514] Processing DeleteTablet for tablet 545b7c2824434d0ab4bd519812b1edd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:17 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:54974
I20260808 17:50:17.908017 32052 tablet_replica.cc:330] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088: stopping tablet replica
I20260808 17:50:17.908073 32052 raft_consensus.cc:2229] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:50:17.908130 32052 raft_consensus.cc:2258] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:17.908355 32052 ts_tablet_manager.cc:1905] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:17.908576 32049 tablet_replica.cc:330] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd: stopping tablet replica
I20260808 17:50:17.908816 32049 raft_consensus.cc:2229] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:17.908870 32049 raft_consensus.cc:2258] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:17.909103 32049 ts_tablet_manager.cc:1905] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:17.909972 32052 ts_tablet_manager.cc:1918] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:50:17.910024 32052 log.cc:1196] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/545b7c2824434d0ab4bd519812b1edd9
I20260808 17:50:17.910214 32052 ts_tablet_manager.cc:1939] T 545b7c2824434d0ab4bd519812b1edd9 P e07763f7f0bf4507affc4fded5686088: Deleting consensus metadata
I20260808 17:50:17.910501 31174 catalog_manager.cc:4841] TS e07763f7f0bf4507affc4fded5686088 (127.28.213.131:34245): tablet 545b7c2824434d0ab4bd519812b1edd9 (table test-table [id=6fcce3aa4fcc4b2ab1911eecd7b3e464]) successfully deleted
I20260808 17:50:17.910778 32049 ts_tablet_manager.cc:1918] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:50:17.910837 32049 log.cc:1196] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/545b7c2824434d0ab4bd519812b1edd9
I20260808 17:50:17.911041 32049 ts_tablet_manager.cc:1939] T 545b7c2824434d0ab4bd519812b1edd9 P a5ece77c31634b3bbcec70ba5729a4bd: Deleting consensus metadata
I20260808 17:50:17.911314 32050 tablet_replica.cc:330] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb: stopping tablet replica
I20260808 17:50:17.911329 31167 catalog_manager.cc:4841] TS a5ece77c31634b3bbcec70ba5729a4bd (127.28.213.130:44547): tablet 545b7c2824434d0ab4bd519812b1edd9 (table test-table [id=6fcce3aa4fcc4b2ab1911eecd7b3e464]) successfully deleted
I20260808 17:50:17.911375 32050 raft_consensus.cc:2229] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:17.911415 32050 raft_consensus.cc:2258] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:17.911623 32050 ts_tablet_manager.cc:1905] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:17.912964 32050 ts_tablet_manager.cc:1918] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:50:17.913025 32050 log.cc:1196] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786211411189989-29526-0/minicluster-data/ts-0/wal/wals/545b7c2824434d0ab4bd519812b1edd9
I20260808 17:50:17.913245 32050 ts_tablet_manager.cc:1939] T 545b7c2824434d0ab4bd519812b1edd9 P d4ed901f4bda4b118539c06c6e86a0bb: Deleting consensus metadata
I20260808 17:50:17.913528 31166 catalog_manager.cc:4841] TS d4ed901f4bda4b118539c06c6e86a0bb (127.28.213.129:32783): tablet 545b7c2824434d0ab4bd519812b1edd9 (table test-table [id=6fcce3aa4fcc4b2ab1911eecd7b3e464]) successfully deleted
Aug 08 17:50:17 dist-test-slave-bndk krb5kdc[31124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211417, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.213.129@KRBTEST.COM
I20260808 17:50:17.919672 32057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.908702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56604 (local address 127.28.213.129:32783)
0808 17:50:17.911502 (+ 2800us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:17.911503 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:17.911616 (+ 113us) server_negotiation.cc:407] Connection header received
0808 17:50:17.911678 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:17.911679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:17.911710 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:17.911789 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:17.912442 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.913160 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.914208 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.914392 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.914444 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.916942 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:17.916950 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:17.916951 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:17.916957 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:17.918558 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:17.918972 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:17.918976 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:17.918976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:17.919036 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:17.919210 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:17.919210 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:17.919211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:17.919338 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:17.919446 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:17.919541 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 17:50:17.919603 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2772,"thread_start_us":86,"threads_started":1}
W20260808 17:50:17.920076 31486 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56604
I20260808 17:50:17.927071 32010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:17.920988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40760 (local address 127.28.213.190:36281)
0808 17:50:17.921034 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:17.921036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:17.921118 (+ 82us) server_negotiation.cc:407] Connection header received
0808 17:50:17.921176 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:17.921177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:17.921186 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:17.921266 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:17.921837 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.922300 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.923221 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:17.923398 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:17.923442 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:17.924609 (+ 1167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:17.924610 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:17.924611 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:17.924617 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:17.926121 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:17.926414 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:17.926414 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:17.926415 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:17.926475 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:17.926623 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:17.926623 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:17.926624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:17.926747 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:17.926835 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:17.926905 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 17:50:17.926984 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 17:50:17.927268 31187 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40760
I20260808 17:50:17.927721 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 31299
I20260808 17:50:17.942963 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 31520
I20260808 17:50:17.963403 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 31726
I20260808 17:50:17.972651 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 31143
2026-08-08T17:50:17Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2789 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:50:18 dist-test-slave-bndk krb5kdc[32065](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:50:18 dist-test-slave-bndk krb5kdc[32065](info): set up 2 sockets
Aug 08 17:50:18 dist-test-slave-bndk krb5kdc[32065](info): commencing operation
krb5kdc: starting...
W20260808 17:50:19.091701 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:50:19 dist-test-slave-bndk krb5kdc[32065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211419, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:50:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:50:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:50:19.199281 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:38655
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:46599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:38655
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:19.277667 32083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:19.277858 32083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:19.277889 32083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:19.278976 32083 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:19.279016 32083 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 17:50:19.279033 32083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:19.279050 32083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:19.279064 32083 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:19.279081 32083 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:50:19.280484 32083 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:46599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:38655
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:38655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32083
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:19.280707 32083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:19.280906 32083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:19.285312 32090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:19.285341 32096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:19.285336 32092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:19.285396 32083 server_base.cc:1034] running on GCE node
I20260808 17:50:19.285715 32083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:19.285969 32083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:19.287122 32083 hybrid_clock.cc:648] HybridClock initialized: now 1786211419287100 us; error 35 us; skew 500 ppm
Aug 08 17:50:19 dist-test-slave-bndk krb5kdc[32065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211419, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:19.289486 32083 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:50:19.289884 32083 webserver.cc:460] Webserver started at http://127.28.213.190:32819/ using document root <none> and password file <none>
I20260808 17:50:19.290071 32083 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:19.290114 32083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:19.290233 32083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:19.291218 32083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "473aa1cdb3a44230bd58e139912e8c8f"
format_stamp: "Formatted at 2026-08-08 17:50:19 on dist-test-slave-bndk"
server_key: "29fba19508c16f9f7a8ac6683c7d6686"
server_key_iv: "b42b96a731962fd54ef5f94ee6522ac8"
server_key_version: "encryptionkey@0"
I20260808 17:50:19.291572 32083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "473aa1cdb3a44230bd58e139912e8c8f"
format_stamp: "Formatted at 2026-08-08 17:50:19 on dist-test-slave-bndk"
server_key: "29fba19508c16f9f7a8ac6683c7d6686"
server_key_iv: "b42b96a731962fd54ef5f94ee6522ac8"
server_key_version: "encryptionkey@0"
I20260808 17:50:19.292888 32083 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:50:19.293606 32103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:19.293751 32083 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:19.293833 32083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "473aa1cdb3a44230bd58e139912e8c8f"
format_stamp: "Formatted at 2026-08-08 17:50:19 on dist-test-slave-bndk"
server_key: "29fba19508c16f9f7a8ac6683c7d6686"
server_key_iv: "b42b96a731962fd54ef5f94ee6522ac8"
server_key_version: "encryptionkey@0"
I20260808 17:50:19.293896 32083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:19.301369 32083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:19.302968 32083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:19.303099 32083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:19.307503 32083 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:38655
I20260808 17:50:19.307580 32198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:38655 every 8 connection(s)
I20260808 17:50:19.307852 32083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:50:19.308439 32201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:19.310683 32201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f: Bootstrap starting.
I20260808 17:50:19.311237 32201 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:19.311525 32201 log.cc:824] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:19.312234 32201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f: No bootstrap required, opened a new log
I20260808 17:50:19.313191 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 32083
I20260808 17:50:19.313287 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:50:19.313443 29526 external_mini_cluster.cc:1428] Setting key 03d18bbf22eb45b550a0ec4216574cac
I20260808 17:50:19.314393 32201 raft_consensus.cc:348] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "473aa1cdb3a44230bd58e139912e8c8f" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38655 } }
I20260808 17:50:19.314633 32201 raft_consensus.cc:374] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:19.314718 32201 raft_consensus.cc:729] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 473aa1cdb3a44230bd58e139912e8c8f, State: Initialized, Role: FOLLOWER
I20260808 17:50:19.314851 32201 consensus_queue.cc:260] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "473aa1cdb3a44230bd58e139912e8c8f" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38655 } }
I20260808 17:50:19.314944 32201 raft_consensus.cc:388] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:50:19.314976 32201 raft_consensus.cc:482] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:50:19.315021 32201 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:19.315565 32201 raft_consensus.cc:504] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "473aa1cdb3a44230bd58e139912e8c8f" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38655 } }
I20260808 17:50:19.315665 32201 leader_election.cc:302] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 473aa1cdb3a44230bd58e139912e8c8f; no voters:
I20260808 17:50:19.315821 32201 leader_election.cc:288] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:50:19.315896 32211 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:19.316006 32211 raft_consensus.cc:686] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f [term 1 LEADER]: Becoming Leader. State: Replica: 473aa1cdb3a44230bd58e139912e8c8f, State: Running, Role: LEADER
I20260808 17:50:19.316119 32201 sys_catalog.cc:564] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:19.316088 32211 consensus_queue.cc:237] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "473aa1cdb3a44230bd58e139912e8c8f" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38655 } }
I20260808 17:50:19.316493 32212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "473aa1cdb3a44230bd58e139912e8c8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "473aa1cdb3a44230bd58e139912e8c8f" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38655 } } }
I20260808 17:50:19.316506 32213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 473aa1cdb3a44230bd58e139912e8c8f. Latest consensus state: current_term: 1 leader_uuid: "473aa1cdb3a44230bd58e139912e8c8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "473aa1cdb3a44230bd58e139912e8c8f" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38655 } } }
I20260808 17:50:19.316658 32212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:19.316673 32213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:19.317338 32217 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:50:19.317813 32217 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:50:19.319248 32217 catalog_manager.cc:1347] Generated new cluster ID: 7b546d5d27dc48feb9a99015750604d0
I20260808 17:50:19.319301 32217 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:50:19 dist-test-slave-bndk krb5kdc[32065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211419, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:19.323873 32208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.314399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39422 (local address 127.28.213.190:38655)
0808 17:50:19.314583 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:19.314593 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:19.314636 (+ 43us) server_negotiation.cc:407] Connection header received
0808 17:50:19.314767 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:19.314786 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:19.314843 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:19.314975 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:19.315611 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.316866 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.317937 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.318404 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.318505 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.320933 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:19.320937 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:19.320937 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:19.320949 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:19.322480 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:19.322798 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:19.322801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:19.322802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:19.322896 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:19.323077 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:19.323078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:19.323078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:19.323307 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:19.323449 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:19.323554 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 17:50:19.323688 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":91,"threads_started":1}
I20260808 17:50:19.331219 32217 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:50:19.331902 32217 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:50:19.340157 32217 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f: Generated new TSK 0
I20260808 17:50:19.340313 32217 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
I20260808 17:50:19.367815 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38655
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:46599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:19.448305 32245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:19.448499 32245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:19.448520 32245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:19.449661 32245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:19.449700 32245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:19.449721 32245 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 17:50:19.449744 32245 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 17:50:19.449774 32245 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:50:19.451187 32245 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:46599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.213.190:38655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:19.451421 32245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:19.451637 32245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:19.456230 32251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:19.456234 32253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:19.456257 32250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:19.456251 32245 server_base.cc:1034] running on GCE node
I20260808 17:50:19.456634 32245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:19.456821 32245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:19.457963 32245 hybrid_clock.cc:648] HybridClock initialized: now 1786211419457948 us; error 30 us; skew 500 ppm
Aug 08 17:50:19 dist-test-slave-bndk krb5kdc[32065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211419, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:19.460246 32245 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:50:19.460620 32245 webserver.cc:460] Webserver started at http://127.28.213.129:41683/ using document root <none> and password file <none>
I20260808 17:50:19.460803 32245 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:19.460851 32245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:19.460968 32245 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:19.461982 32245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "3cfbf5f8533f42fe94ec5d06911fecf0"
format_stamp: "Formatted at 2026-08-08 17:50:19 on dist-test-slave-bndk"
server_key: "8a7a8850126a6d23178442a0f326506c"
server_key_iv: "20be401cb878f2b0d0cec67f00240e1a"
server_key_version: "encryptionkey@0"
I20260808 17:50:19.462298 32245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "3cfbf5f8533f42fe94ec5d06911fecf0"
format_stamp: "Formatted at 2026-08-08 17:50:19 on dist-test-slave-bndk"
server_key: "8a7a8850126a6d23178442a0f326506c"
server_key_iv: "20be401cb878f2b0d0cec67f00240e1a"
server_key_version: "encryptionkey@0"
I20260808 17:50:19.463515 32245 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:50:19.464143 32263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:19.464286 32245 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:19.464367 32245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "3cfbf5f8533f42fe94ec5d06911fecf0"
format_stamp: "Formatted at 2026-08-08 17:50:19 on dist-test-slave-bndk"
server_key: "8a7a8850126a6d23178442a0f326506c"
server_key_iv: "20be401cb878f2b0d0cec67f00240e1a"
server_key_version: "encryptionkey@0"
I20260808 17:50:19.464429 32245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:19.476446 32245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:19.478420 32245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:19.478550 32245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:19.479001 32245 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:19.479044 32245 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:19.479071 32245 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:19.479087 32245 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 17:50:19 dist-test-slave-bndk krb5kdc[32065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211419, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:19.485648 32245 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:32829
I20260808 17:50:19.485714 32448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:32829 every 8 connection(s)
I20260808 17:50:19.486047 32245 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:50:19.487695 32208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.479418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:44857 (local address 127.28.213.190:38655)
0808 17:50:19.479485 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:19.479488 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:19.479637 (+ 149us) server_negotiation.cc:407] Connection header received
0808 17:50:19.480070 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:19.480072 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:19.480088 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:19.480160 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:19.480864 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.481634 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.482756 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.482961 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.483017 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.485161 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:19.485163 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:19.485163 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:19.485171 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:19.486679 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:19.487025 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:19.487026 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:19.487026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:19.487075 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:19.487232 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:19.487232 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:19.487232 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:19.487323 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:19.487388 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:19.487569 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 17:50:19.487634 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 17:50:19.487841 32280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.479357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38655 (local address 127.28.213.129:44857)
0808 17:50:19.479516 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:19.479553 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:19.479981 (+ 428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:19.480221 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:19.480226 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:19.480506 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:19.480762 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.480769 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.481733 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.481735 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.482665 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.482668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.483044 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.483045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.483177 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.483667 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:19.483675 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:19.485074 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:19.486755 (+ 1681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:19.486758 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:19.486760 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:19.486970 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:19.487112 (+ 142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:19.487113 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:19.487113 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:19.487192 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:19.487382 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:19.487384 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:19.487483 (+ 99us) client_negotiation.cc:769] Sending connection context
0808 17:50:19.487554 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 17:50:19.487660 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":95,"threads_started":1}
I20260808 17:50:19.488307 32455 heartbeater.cc:347] Connected to a master server at 127.28.213.190:38655
I20260808 17:50:19.488389 32455 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:19.488569 32455 heartbeater.cc:511] Master 127.28.213.190:38655 requested a full tablet report, sending...
I20260808 17:50:19.489090 32125 ts_manager.cc:194] Registered new tserver with Master: 3cfbf5f8533f42fe94ec5d06911fecf0 (127.28.213.129:32829)
I20260808 17:50:19.489763 32125 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:44857
I20260808 17:50:19.492098 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 32245
I20260808 17:50:19.492173 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:50:19.492345 29526 external_mini_cluster.cc:1428] Setting key a050a27a384047093dae688ad90c7a46
I20260808 17:50:19.494441 32208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.489280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:35869 (local address 127.28.213.190:38655)
0808 17:50:19.489315 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:19.489317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:19.489463 (+ 146us) server_negotiation.cc:407] Connection header received
0808 17:50:19.489517 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:19.489518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:19.489527 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:19.489578 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:19.489881 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.490584 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.491207 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.491417 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.491470 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.492255 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:19.492256 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:19.492257 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:19.492264 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:19.493517 (+ 1253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:19.493803 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:19.493804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:19.493805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:19.493857 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:19.494016 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:19.494017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:19.494017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:19.494114 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:19.494167 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:19.494295 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 17:50:19.494358 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:50:19.494457 32462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.489255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38655 (local address 127.28.213.129:35869)
0808 17:50:19.489398 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:19.489413 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:19.489465 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:19.489582 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:19.489583 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:19.489741 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:19.489784 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.489785 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.490659 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.490660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.491141 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.491142 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.491476 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.491477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.491547 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.491888 (+ 341us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:19.491893 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:19.492150 (+ 257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:19.493589 (+ 1439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:19.493590 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:19.493591 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:19.493745 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:19.493909 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:19.493910 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:19.493910 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:19.493966 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:19.494165 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:19.494166 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:19.494208 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 17:50:19.494268 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 17:50:19.494359 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":83,"threads_started":1}
WARNING: no policy specified for kudu/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
I20260808 17:50:19.515594 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38655
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:46599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:19.594926 32467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:19.595109 32467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:19.595131 32467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:19.596223 32467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:19.596264 32467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:19.596292 32467 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 17:50:19.596306 32467 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 17:50:19.596329 32467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:50:19.597769 32467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:46599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.213.190:38655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:19.598004 32467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:19.598206 32467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:19.602699 32478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:19.602700 32475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:19.602741 32474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:19.602913 32467 server_base.cc:1034] running on GCE node
I20260808 17:50:19.603085 32467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:19.603281 32467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:19.604411 32467 hybrid_clock.cc:648] HybridClock initialized: now 1786211419604394 us; error 30 us; skew 500 ppm
Aug 08 17:50:19 dist-test-slave-bndk krb5kdc[32065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211419, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:19.606709 32467 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:50:19.607105 32467 webserver.cc:460] Webserver started at http://127.28.213.130:38313/ using document root <none> and password file <none>
I20260808 17:50:19.607306 32467 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:19.607348 32467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:19.607475 32467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:19.608449 32467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "14077a91c23640d6883b3b711dd67372"
format_stamp: "Formatted at 2026-08-08 17:50:19 on dist-test-slave-bndk"
server_key: "fce6008009922be43a1bf7d9ac4d0a41"
server_key_iv: "83a9804f10e8d85f30fa3aba907c1cda"
server_key_version: "encryptionkey@0"
I20260808 17:50:19.608768 32467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "14077a91c23640d6883b3b711dd67372"
format_stamp: "Formatted at 2026-08-08 17:50:19 on dist-test-slave-bndk"
server_key: "fce6008009922be43a1bf7d9ac4d0a41"
server_key_iv: "83a9804f10e8d85f30fa3aba907c1cda"
server_key_version: "encryptionkey@0"
I20260808 17:50:19.610019 32467 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:50:19.610663 32487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:19.610826 32467 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:19.610899 32467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "14077a91c23640d6883b3b711dd67372"
format_stamp: "Formatted at 2026-08-08 17:50:19 on dist-test-slave-bndk"
server_key: "fce6008009922be43a1bf7d9ac4d0a41"
server_key_iv: "83a9804f10e8d85f30fa3aba907c1cda"
server_key_version: "encryptionkey@0"
I20260808 17:50:19.610954 32467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:19.623739 32467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:19.625702 32467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:19.625803 32467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:19.626206 32467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:19.626243 32467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:19.626262 32467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:19.626273 32467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:19.632411 32467 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:37049
I20260808 17:50:19.632437 32671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:37049 every 8 connection(s)
Aug 08 17:50:19 dist-test-slave-bndk krb5kdc[32065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211419, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:19.632755 32467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:50:19.635145 32208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.626619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:37319 (local address 127.28.213.190:38655)
0808 17:50:19.626682 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:19.626685 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:19.626829 (+ 144us) server_negotiation.cc:407] Connection header received
0808 17:50:19.627260 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:19.627262 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:19.627275 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:19.627351 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:19.628083 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.628823 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.630275 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.630572 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.630640 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.633040 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:19.633043 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:19.633043 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:19.633051 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:19.634146 (+ 1095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:19.634481 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:19.634482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:19.634483 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:19.634528 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:19.634698 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:19.634699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:19.634699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:19.634788 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:19.634831 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:19.635025 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 17:50:19.635082 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 17:50:19.635277 32501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.626564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38655 (local address 127.28.213.130:37319)
0808 17:50:19.626714 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:19.626751 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:19.627176 (+ 425us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:19.627433 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:19.627438 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:19.627725 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:19.627984 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.627991 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.628916 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.628917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.630168 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.630172 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.630668 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.630669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.630805 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.631266 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:19.631288 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:19.632934 (+ 1646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:19.634209 (+ 1275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:19.634215 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:19.634216 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:19.634423 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:19.634571 (+ 148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:19.634571 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:19.634571 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:19.634658 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:19.634827 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:19.634830 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:19.634933 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 17:50:19.635006 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 17:50:19.635113 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":87,"threads_started":1}
I20260808 17:50:19.635694 32673 heartbeater.cc:347] Connected to a master server at 127.28.213.190:38655
I20260808 17:50:19.635773 32673 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:19.635941 32673 heartbeater.cc:511] Master 127.28.213.190:38655 requested a full tablet report, sending...
I20260808 17:50:19.636292 32124 ts_manager.cc:194] Registered new tserver with Master: 14077a91c23640d6883b3b711dd67372 (127.28.213.130:37049)
I20260808 17:50:19.636706 32124 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:37319
I20260808 17:50:19.640223 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 32467
I20260808 17:50:19.640321 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:50:19.640511 29526 external_mini_cluster.cc:1428] Setting key d6cc2aaa23b801ce1031ddf38667206b
I20260808 17:50:19.641569 32208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.636671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:33283 (local address 127.28.213.190:38655)
0808 17:50:19.636708 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:19.636710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:19.636782 (+ 72us) server_negotiation.cc:407] Connection header received
0808 17:50:19.636882 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:19.636882 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:19.636890 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:19.636926 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:19.637269 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.637709 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.638353 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.638550 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.638603 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.639345 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:19.639346 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:19.639346 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:19.639353 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:19.640502 (+ 1149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:19.640853 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:19.640854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:19.640855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:19.640932 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:19.641081 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:19.641081 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:19.641082 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:19.641272 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:19.641332 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:19.641452 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 17:50:19.641513 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:50:19.641628 32680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.636597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38655 (local address 127.28.213.130:33283)
0808 17:50:19.636710 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:19.636721 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:19.636784 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:19.636942 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:19.636944 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:19.637108 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:19.637157 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.637159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.637796 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.637797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.638285 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.638287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.638608 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.638609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.638685 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.638987 (+ 302us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:19.638990 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:19.639249 (+ 259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:19.640589 (+ 1340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:19.640590 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:19.640590 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:19.640770 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:19.640984 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:19.640984 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:19.640985 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:19.641035 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:19.641323 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:19.641324 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:19.641367 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 17:50:19.641435 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 17:50:19.641528 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":59,"threads_started":1}
WARNING: no policy specified for kudu/127.28.213.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
I20260808 17:50:19.663793 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38655
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:46599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:19.743511 32685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:19.743691 32685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:19.743713 32685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:19.744751 32685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:19.744784 32685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:19.744802 32685 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 17:50:19.744813 32685 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 17:50:19.744828 32685 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:50:19.746191 32685 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:46599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.213.190:38655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32685
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:19.746356 32685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:19.746520 32685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:19.751346 32696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:19.751406 32691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:19.751350 32692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:19.751509 32685 server_base.cc:1034] running on GCE node
I20260808 17:50:19.751721 32685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:19.751931 32685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:19.753055 32685 hybrid_clock.cc:648] HybridClock initialized: now 1786211419753042 us; error 32 us; skew 500 ppm
Aug 08 17:50:19 dist-test-slave-bndk krb5kdc[32065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211419, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:19.755390 32685 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:50:19.755779 32685 webserver.cc:460] Webserver started at http://127.28.213.131:43617/ using document root <none> and password file <none>
I20260808 17:50:19.755944 32685 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:19.755980 32685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:19.756065 32685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:19.756961 32685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf"
format_stamp: "Formatted at 2026-08-08 17:50:19 on dist-test-slave-bndk"
server_key: "c00522c479529934bb1bc435f4576e58"
server_key_iv: "64cf6eaa3c88f71b6dc6bb9117b3f916"
server_key_version: "encryptionkey@0"
I20260808 17:50:19.757277 32685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf"
format_stamp: "Formatted at 2026-08-08 17:50:19 on dist-test-slave-bndk"
server_key: "c00522c479529934bb1bc435f4576e58"
server_key_iv: "64cf6eaa3c88f71b6dc6bb9117b3f916"
server_key_version: "encryptionkey@0"
I20260808 17:50:19.758404 32685 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:19.759035 32709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:19.759162 32685 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:19.759236 32685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf"
format_stamp: "Formatted at 2026-08-08 17:50:19 on dist-test-slave-bndk"
server_key: "c00522c479529934bb1bc435f4576e58"
server_key_iv: "64cf6eaa3c88f71b6dc6bb9117b3f916"
server_key_version: "encryptionkey@0"
I20260808 17:50:19.759299 32685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:19.783675 32685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:19.785319 32685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:19.785458 32685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:19.785949 32685 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:19.785993 32685 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:19.786020 32685 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:19.786046 32685 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 17:50:19 dist-test-slave-bndk krb5kdc[32065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211419, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:19.793071 32685 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:45733
I20260808 17:50:19.793502 32685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:50:19.794212 404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:45733 every 8 connection(s)
I20260808 17:50:19.794950 32208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.786312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:34335 (local address 127.28.213.190:38655)
0808 17:50:19.786377 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:19.786379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:19.786550 (+ 171us) server_negotiation.cc:407] Connection header received
0808 17:50:19.786977 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:19.786979 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:19.786991 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:19.787069 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:19.787633 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.788406 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.789920 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.790116 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.790172 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.792232 (+ 2060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:19.792233 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:19.792234 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:19.792241 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:19.793762 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:19.794163 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:19.794164 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:19.794165 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:19.794234 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:19.794477 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:19.794477 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:19.794478 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:19.794581 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:19.794632 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:19.794821 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 17:50:19.794879 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 17:50:19.795118 32723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.786275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38655 (local address 127.28.213.131:34335)
0808 17:50:19.786431 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:19.786469 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:19.786886 (+ 417us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:19.787116 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:19.787120 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:19.787333 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:19.787543 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.787548 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.788490 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.788491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.789800 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.789805 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.790191 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.790192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.790329 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.790797 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:19.790807 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:19.792145 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:19.793843 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:19.793847 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:19.793849 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:19.794094 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:19.794304 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:19.794305 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:19.794305 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:19.794422 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:19.794628 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:19.794631 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:19.794732 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 17:50:19.794804 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 17:50:19.794928 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":82,"threads_started":1}
I20260808 17:50:19.795523 405 heartbeater.cc:347] Connected to a master server at 127.28.213.190:38655
I20260808 17:50:19.795603 405 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:19.795774 405 heartbeater.cc:511] Master 127.28.213.190:38655 requested a full tablet report, sending...
I20260808 17:50:19.796119 32125 ts_manager.cc:194] Registered new tserver with Master: 3eb459959c544f8fa5ef5d8b0bd1ecaf (127.28.213.131:45733)
I20260808 17:50:19.796510 32125 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:34335
I20260808 17:50:19.798017 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 32685
I20260808 17:50:19.798110 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:50:19.798276 29526 external_mini_cluster.cc:1428] Setting key ea2f08ee5378b31e9131ee1fde7d4472
I20260808 17:50:19.799036 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:50:19.801837 414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.796476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38655 (local address 127.28.213.131:47757)
0808 17:50:19.796630 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:19.796639 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:19.796696 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:19.796805 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:19.796806 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:19.796969 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:19.797027 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.797029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.797732 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.797733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.798295 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.798297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.798810 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.798811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.798875 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.799257 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:19.799262 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:19.799616 (+ 354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:19.800932 (+ 1316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:19.800933 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:19.800933 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:19.801135 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:19.801352 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:19.801352 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:19.801352 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:19.801401 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:19.801621 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:19.801622 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:19.801654 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 17:50:19.801705 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 17:50:19.801775 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":72,"threads_started":1}
I20260808 17:50:19.801887 32208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.796536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:47757 (local address 127.28.213.190:38655)
0808 17:50:19.796576 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:19.796578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:19.796683 (+ 105us) server_negotiation.cc:407] Connection header received
0808 17:50:19.796737 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:19.796738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:19.796748 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:19.796791 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:19.797094 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.797650 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.798491 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.798753 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.798812 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.799686 (+ 874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:19.799687 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:19.799687 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:19.799693 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:19.800850 (+ 1157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:19.801230 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:19.801231 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:19.801232 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:19.801292 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:19.801452 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:19.801452 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:19.801453 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:19.801568 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:19.801623 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:19.801741 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 17:50:19.801809 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
Aug 08 17:50:19 dist-test-slave-bndk krb5kdc[32065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211419, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 17:50:19 dist-test-slave-bndk krb5kdc[32065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211419, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:19.821928 32208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.815145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39428 (local address 127.28.213.190:38655)
0808 17:50:19.815193 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:19.815194 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:19.815202 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:19.815254 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:19.815255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:19.815262 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:19.815305 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:19.815775 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.816323 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.817101 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.817348 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.817399 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.819780 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:19.819781 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:19.819781 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:19.819788 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:19.820943 (+ 1155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:19.821268 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:19.821269 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:19.821269 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:19.821324 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:19.821490 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:19.821491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:19.821491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:19.821585 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:19.821666 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:19.821765 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 17:50:19.821833 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 17:50:19.823216 32125 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39428:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:50:19.824712 32125 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:50:19.830394 431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.826600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:32829 (local address 127.0.0.1:40580)
0808 17:50:19.826884 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:19.826936 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:19.827009 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:19.827221 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:19.827225 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:19.827227 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:19.827288 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.827290 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.828222 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.828223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.829194 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.829197 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.830114 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.830115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.830194 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.830208 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 17:50:19.830271 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 17:50:19.830323 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":49,"threads_started":1}
I20260808 17:50:19.830430 433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.826704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40580 (local address 127.28.213.129:32829)
0808 17:50:19.826875 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:19.826880 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:19.827002 (+ 122us) server_negotiation.cc:407] Connection header received
0808 17:50:19.827110 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:19.827111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:19.827128 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:19.827215 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:19.827373 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.828151 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.829309 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.830048 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.830109 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.830166 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:19.830291 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 17:50:19.830327 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":83,"threads_started":1}
I20260808 17:50:19.830780 432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.826607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:37049 (local address 127.0.0.1:54436)
0808 17:50:19.827162 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:19.827171 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:19.827219 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:19.827479 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:19.827480 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:19.827482 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:19.827521 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.827522 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.828798 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.828799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.829664 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.829667 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.830561 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.830562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.830621 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.830625 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:19.830677 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 17:50:19.830713 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"mutex_wait_us":2,"thread_start_us":48,"threads_started":1}
I20260808 17:50:19.830838 435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.826827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54436 (local address 127.28.213.130:37049)
0808 17:50:19.827159 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:19.827163 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:19.827272 (+ 109us) server_negotiation.cc:407] Connection header received
0808 17:50:19.827316 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:19.827318 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:19.827334 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:19.827400 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:19.827594 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.828716 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.829734 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.830391 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.830463 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.830521 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:19.830707 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 17:50:19.830749 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":245,"threads_started":1}
I20260808 17:50:19.831048 32344 tablet_service.cc:1467] Processing CreateTablet for tablet b2fec0d9188f49758cf7148092d05df6 (DEFAULT_TABLE table=test-table [id=ad794d89cfe2441f9c62093153814be0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:19.831420 32344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2fec0d9188f49758cf7148092d05df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:19.831537 32568 tablet_service.cc:1467] Processing CreateTablet for tablet b2fec0d9188f49758cf7148092d05df6 (DEFAULT_TABLE table=test-table [id=ad794d89cfe2441f9c62093153814be0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:19.831712 434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.826788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39854 (local address 127.28.213.131:45733)
0808 17:50:19.826948 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:19.826952 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:19.827199 (+ 247us) server_negotiation.cc:407] Connection header received
0808 17:50:19.827346 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:19.827349 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:19.827366 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:19.827450 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:19.827650 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.828683 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.829954 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.831301 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.831365 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.831426 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:19.831586 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 17:50:19.831626 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":68,"threads_started":1}
I20260808 17:50:19.831863 32568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2fec0d9188f49758cf7148092d05df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:19.831923 430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.826600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:45733 (local address 127.0.0.1:39854)
0808 17:50:19.827135 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:19.827143 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:19.827225 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:19.827508 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:19.827509 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:19.827511 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:19.827557 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.827559 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.828771 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.828772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.829863 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.829866 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.831374 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.831375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.831436 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.831439 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:50:19.831810 (+ 371us) client_negotiation.cc:240] Negotiation successful
0808 17:50:19.831851 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"mutex_wait_us":36,"thread_start_us":42,"threads_started":1}
I20260808 17:50:19.833745 310 tablet_service.cc:1467] Processing CreateTablet for tablet b2fec0d9188f49758cf7148092d05df6 (DEFAULT_TABLE table=test-table [id=ad794d89cfe2441f9c62093153814be0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:19.834029 310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2fec0d9188f49758cf7148092d05df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:19.835047 438 tablet_bootstrap.cc:492] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0: Bootstrap starting.
I20260808 17:50:19.835309 439 tablet_bootstrap.cc:492] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372: Bootstrap starting.
I20260808 17:50:19.835834 438 tablet_bootstrap.cc:654] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:19.835855 439 tablet_bootstrap.cc:654] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:19.836129 439 log.cc:824] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:19.836160 438 log.cc:824] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:19.836875 439 tablet_bootstrap.cc:492] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372: No bootstrap required, opened a new log
I20260808 17:50:19.836887 444 tablet_bootstrap.cc:492] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Bootstrap starting.
I20260808 17:50:19.836949 439 ts_tablet_manager.cc:1397] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:50:19.837669 438 tablet_bootstrap.cc:492] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0: No bootstrap required, opened a new log
I20260808 17:50:19.837731 444 tablet_bootstrap.cc:654] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:19.837746 438 ts_tablet_manager.cc:1397] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 17:50:19.838059 444 log.cc:824] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:19.838615 439 raft_consensus.cc:348] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:19.838740 439 raft_consensus.cc:374] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:19.838770 439 raft_consensus.cc:729] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14077a91c23640d6883b3b711dd67372, State: Initialized, Role: FOLLOWER
I20260808 17:50:19.838784 444 tablet_bootstrap.cc:492] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: No bootstrap required, opened a new log
I20260808 17:50:19.838840 444 ts_tablet_manager.cc:1397] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:50:19.838879 439 consensus_queue.cc:260] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:19.839221 439 ts_tablet_manager.cc:1428] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:50:19.839418 32673 heartbeater.cc:503] Master 127.28.213.190:38655 was elected leader, sending a full tablet report...
I20260808 17:50:19.839592 438 raft_consensus.cc:348] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:19.839751 438 raft_consensus.cc:374] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:19.839783 438 raft_consensus.cc:729] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfbf5f8533f42fe94ec5d06911fecf0, State: Initialized, Role: FOLLOWER
I20260808 17:50:19.839902 438 consensus_queue.cc:260] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:19.840149 438 ts_tablet_manager.cc:1428] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:50:19.840224 32455 heartbeater.cc:503] Master 127.28.213.190:38655 was elected leader, sending a full tablet report...
I20260808 17:50:19.840667 444 raft_consensus.cc:348] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:19.840816 444 raft_consensus.cc:374] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:19.840844 444 raft_consensus.cc:729] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eb459959c544f8fa5ef5d8b0bd1ecaf, State: Initialized, Role: FOLLOWER
I20260808 17:50:19.840945 444 consensus_queue.cc:260] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:19.841176 444 ts_tablet_manager.cc:1428] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:50:19.841197 405 heartbeater.cc:503] Master 127.28.213.190:38655 was elected leader, sending a full tablet report...
W20260808 17:50:19.883248 32674 tablet.cc:2369] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:50:19.937362 448 raft_consensus.cc:482] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:50:19.937495 448 raft_consensus.cc:504] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:19.937836 448 leader_election.cc:288] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cfbf5f8533f42fe94ec5d06911fecf0 (127.28.213.129:32829), 14077a91c23640d6883b3b711dd67372 (127.28.213.130:37049)
I20260808 17:50:19.940721 433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.938073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:51771 (local address 127.28.213.129:32829)
0808 17:50:19.938120 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:19.938122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:19.938133 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:50:19.938166 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:19.938167 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:19.938176 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:19.938231 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:19.938378 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.938840 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.939767 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.940408 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.940473 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.940480 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:19.940622 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 17:50:19.940660 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:50:19.940711 435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.938103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:57447 (local address 127.28.213.130:37049)
0808 17:50:19.938142 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:19.938143 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:19.938259 (+ 116us) server_negotiation.cc:407] Connection header received
0808 17:50:19.938292 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:19.938292 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:19.938301 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:19.938348 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:19.938488 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.938949 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.939825 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.940369 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.940457 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.940468 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:19.940603 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 17:50:19.940645 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:50:19.940706 32723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.937994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:32829 (local address 127.28.213.131:51771)
0808 17:50:19.938053 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:19.938065 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:19.938112 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:19.938253 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:19.938254 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:19.938256 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:19.938318 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.938319 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.938914 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.938915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.939666 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.939668 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.940478 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.940479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.940559 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.940561 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:50:19.940611 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 17:50:19.940641 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":26}
I20260808 17:50:19.940713 450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.938020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:37049 (local address 127.28.213.131:57447)
0808 17:50:19.938195 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:19.938202 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:19.938244 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:19.938350 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:19.938351 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:19.938352 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:19.938429 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.938430 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.939022 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.939023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.939729 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.939730 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.940453 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.940454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.940528 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.940532 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:19.940590 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 17:50:19.940625 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":115,"threads_started":1}
I20260808 17:50:19.941099 32380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2fec0d9188f49758cf7148092d05df6" candidate_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" is_pre_election: true
I20260808 17:50:19.941256 32380 raft_consensus.cc:2454] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eb459959c544f8fa5ef5d8b0bd1ecaf in term 0.
I20260808 17:50:19.941318 32595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2fec0d9188f49758cf7148092d05df6" candidate_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14077a91c23640d6883b3b711dd67372" is_pre_election: true
I20260808 17:50:19.941466 32595 raft_consensus.cc:2454] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eb459959c544f8fa5ef5d8b0bd1ecaf in term 0.
I20260808 17:50:19.941483 32714 leader_election.cc:302] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfbf5f8533f42fe94ec5d06911fecf0, 3eb459959c544f8fa5ef5d8b0bd1ecaf; no voters:
I20260808 17:50:19.941602 448 raft_consensus.cc:2781] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:50:19.941659 448 raft_consensus.cc:482] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:50:19.941680 448 raft_consensus.cc:3037] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:19.942373 448 raft_consensus.cc:504] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:19.942487 448 leader_election.cc:288] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [CANDIDATE]: Term 1 election: Requested vote from peers 3cfbf5f8533f42fe94ec5d06911fecf0 (127.28.213.129:32829), 14077a91c23640d6883b3b711dd67372 (127.28.213.130:37049)
I20260808 17:50:19.942625 32595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2fec0d9188f49758cf7148092d05df6" candidate_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14077a91c23640d6883b3b711dd67372"
I20260808 17:50:19.942646 32380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2fec0d9188f49758cf7148092d05df6" candidate_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0"
I20260808 17:50:19.942698 32595 raft_consensus.cc:3037] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:19.942713 32380 raft_consensus.cc:3037] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:19.943369 32380 raft_consensus.cc:2454] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eb459959c544f8fa5ef5d8b0bd1ecaf in term 1.
I20260808 17:50:19.943429 32595 raft_consensus.cc:2454] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eb459959c544f8fa5ef5d8b0bd1ecaf in term 1.
I20260808 17:50:19.943545 32714 leader_election.cc:302] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfbf5f8533f42fe94ec5d06911fecf0, 3eb459959c544f8fa5ef5d8b0bd1ecaf; no voters:
I20260808 17:50:19.943663 448 raft_consensus.cc:2781] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:19.943827 448 raft_consensus.cc:686] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 LEADER]: Becoming Leader. State: Replica: 3eb459959c544f8fa5ef5d8b0bd1ecaf, State: Running, Role: LEADER
I20260808 17:50:19.943912 448 consensus_queue.cc:237] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:19.944711 32125 catalog_manager.cc:5495] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 3eb459959c544f8fa5ef5d8b0bd1ecaf (127.28.213.131). New cstate: current_term: 1 leader_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } health_report { overall_health: HEALTHY } } }
W20260808 17:50:19.986742 32456 tablet.cc:2369] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 17:50:19 dist-test-slave-bndk krb5kdc[32065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211419, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:19.999855 462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.993749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38655 (local address 127.0.0.1:39444)
0808 17:50:19.993890 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:19.993911 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:19.993976 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:19.994090 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:19.994091 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:19.994396 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:19.994446 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.994448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.995053 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.995055 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.995602 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:19.995604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.995914 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.995915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:19.995965 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.996461 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:19.996466 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:19.997837 (+ 1371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:19.999032 (+ 1195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:19.999039 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:19.999041 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:19.999221 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:19.999356 (+ 135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:19.999357 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:19.999357 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:19.999420 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:19.999596 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:19.999601 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:19.999639 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 17:50:19.999698 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:50:19.999784 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":72,"threads_started":1}
I20260808 17:50:19.999936 32208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:19.993814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39444 (local address 127.28.213.190:38655)
0808 17:50:19.993882 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:19.993884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:19.993965 (+ 81us) server_negotiation.cc:407] Connection header received
0808 17:50:19.994031 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:19.994032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:19.994041 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:19.994081 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:19.994519 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.994986 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.995673 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:19.995851 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:19.995904 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:19.997915 (+ 2011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:19.997916 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:19.997916 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:19.997923 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:19.998961 (+ 1038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:19.999273 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:19.999273 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:19.999274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:19.999315 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:19.999468 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:19.999468 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:19.999469 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:19.999556 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:19.999599 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:19.999730 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 17:50:19.999839 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":41}
I20260808 17:50:20.001556 32125 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:39444:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 17:50:20.001731 32125 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:50:20.003019 32344 tablet_service.cc:1467] Processing CreateTablet for tablet 5d25b11fa4224438a334579ce543b369 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f8434ab1d0c747e5bb5d33b726a3151d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 17:50:20.003037 310 tablet_service.cc:1467] Processing CreateTablet for tablet 5d25b11fa4224438a334579ce543b369 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f8434ab1d0c747e5bb5d33b726a3151d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 17:50:20.003070 32568 tablet_service.cc:1467] Processing CreateTablet for tablet 5d25b11fa4224438a334579ce543b369 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f8434ab1d0c747e5bb5d33b726a3151d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 17:50:20.003192 310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d25b11fa4224438a334579ce543b369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:20.003191 32344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d25b11fa4224438a334579ce543b369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:20.003219 32568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d25b11fa4224438a334579ce543b369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:20.004308 439 tablet_bootstrap.cc:492] T 5d25b11fa4224438a334579ce543b369 P 14077a91c23640d6883b3b711dd67372: Bootstrap starting.
I20260808 17:50:20.004685 438 tablet_bootstrap.cc:492] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0: Bootstrap starting.
I20260808 17:50:20.004957 444 tablet_bootstrap.cc:492] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Bootstrap starting.
I20260808 17:50:20.004987 439 tablet_bootstrap.cc:654] T 5d25b11fa4224438a334579ce543b369 P 14077a91c23640d6883b3b711dd67372: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:20.005036 438 tablet_bootstrap.cc:654] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:20.005365 444 tablet_bootstrap.cc:654] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:20.005685 438 tablet_bootstrap.cc:492] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0: No bootstrap required, opened a new log
I20260808 17:50:20.005738 438 ts_tablet_manager.cc:1397] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:20.005795 439 tablet_bootstrap.cc:492] T 5d25b11fa4224438a334579ce543b369 P 14077a91c23640d6883b3b711dd67372: No bootstrap required, opened a new log
I20260808 17:50:20.005849 439 ts_tablet_manager.cc:1397] T 5d25b11fa4224438a334579ce543b369 P 14077a91c23640d6883b3b711dd67372: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:50:20.005889 438 raft_consensus.cc:348] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:20.005965 438 raft_consensus.cc:374] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:20.005992 438 raft_consensus.cc:729] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfbf5f8533f42fe94ec5d06911fecf0, State: Initialized, Role: FOLLOWER
I20260808 17:50:20.005996 439 raft_consensus.cc:348] T 5d25b11fa4224438a334579ce543b369 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:20.006033 438 consensus_queue.cc:260] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:20.006055 444 tablet_bootstrap.cc:492] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: No bootstrap required, opened a new log
I20260808 17:50:20.006075 439 raft_consensus.cc:374] T 5d25b11fa4224438a334579ce543b369 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:20.006093 444 ts_tablet_manager.cc:1397] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 17:50:20.006102 439 raft_consensus.cc:729] T 5d25b11fa4224438a334579ce543b369 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14077a91c23640d6883b3b711dd67372, State: Initialized, Role: FOLLOWER
I20260808 17:50:20.006137 438 ts_tablet_manager.cc:1428] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:20.006141 439 consensus_queue.cc:260] T 5d25b11fa4224438a334579ce543b369 P 14077a91c23640d6883b3b711dd67372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:20.006220 439 ts_tablet_manager.cc:1428] T 5d25b11fa4224438a334579ce543b369 P 14077a91c23640d6883b3b711dd67372: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:20.006230 444 raft_consensus.cc:348] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:20.006251 447 tablet_replica.cc:439] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } } }
I20260808 17:50:20.006289 444 raft_consensus.cc:374] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:20.006309 444 raft_consensus.cc:729] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eb459959c544f8fa5ef5d8b0bd1ecaf, State: Initialized, Role: FOLLOWER
I20260808 17:50:20.006310 447 tablet_replica.cc:442] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:20.006294 446 tablet_replica.cc:439] T 5d25b11fa4224438a334579ce543b369 P 14077a91c23640d6883b3b711dd67372: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } } }
I20260808 17:50:20.006354 446 tablet_replica.cc:442] T 5d25b11fa4224438a334579ce543b369 P 14077a91c23640d6883b3b711dd67372: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:20.006354 444 consensus_queue.cc:260] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:20.006438 444 ts_tablet_manager.cc:1428] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:20.006481 448 tablet_replica.cc:439] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } } }
I20260808 17:50:20.006559 448 tablet_replica.cc:442] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: This TxnStatusTablet replica's current role is: FOLLOWER
W20260808 17:50:20.044412 406 tablet.cc:2369] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:50:20.122202 447 raft_consensus.cc:482] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:50:20.122300 447 raft_consensus.cc:504] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:20.122645 447 leader_election.cc:288] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14077a91c23640d6883b3b711dd67372 (127.28.213.130:37049), 3eb459959c544f8fa5ef5d8b0bd1ecaf (127.28.213.131:45733)
I20260808 17:50:20.126150 468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.122795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:45733 (local address 127.28.213.129:33031)
0808 17:50:20.122917 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:20.122929 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:20.122992 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:20.123130 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:20.123131 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:20.123134 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:20.123206 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:20.123209 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.124085 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.124086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:20.125361 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:20.125366 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.125956 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.125957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:20.126004 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.126008 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:20.126046 (+ 38us) client_negotiation.cc:240] Negotiation successful
0808 17:50:20.126077 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"mutex_wait_us":45,"thread_start_us":69,"threads_started":1}
I20260808 17:50:20.126168 434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.122872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:33031 (local address 127.28.213.131:45733)
0808 17:50:20.122922 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:20.122924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:20.122989 (+ 65us) server_negotiation.cc:407] Connection header received
0808 17:50:20.123061 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:20.123062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:20.123070 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:20.123117 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:20.123269 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.124013 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.125448 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.125862 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.125933 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.125942 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:20.126065 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 17:50:20.126099 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:50:20.126459 338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d25b11fa4224438a334579ce543b369" candidate_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" is_pre_election: true
I20260808 17:50:20.126564 435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.122878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:57955 (local address 127.28.213.130:37049)
0808 17:50:20.122935 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:20.122937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:20.122979 (+ 42us) server_negotiation.cc:407] Connection header received
0808 17:50:20.123050 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:20.123050 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:20.123061 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:20.123117 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:20.123294 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.124018 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.125720 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.126208 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.126273 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.126281 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:20.126479 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 17:50:20.126514 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 17:50:20.126583 469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.122795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:37049 (local address 127.28.213.129:57955)
0808 17:50:20.122923 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:20.122931 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:20.122992 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:20.123130 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:20.123131 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:20.123133 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:20.123232 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:20.123234 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.124086 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.124086 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:20.125646 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:20.125649 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.126320 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.126322 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:20.126397 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.126401 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:20.126459 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 17:50:20.126503 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":27,"thread_start_us":59,"threads_started":1}
I20260808 17:50:20.126583 338 raft_consensus.cc:2454] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cfbf5f8533f42fe94ec5d06911fecf0 in term 0.
I20260808 17:50:20.126777 32267 leader_election.cc:302] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfbf5f8533f42fe94ec5d06911fecf0, 3eb459959c544f8fa5ef5d8b0bd1ecaf; no voters:
I20260808 17:50:20.126787 32595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d25b11fa4224438a334579ce543b369" candidate_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14077a91c23640d6883b3b711dd67372" is_pre_election: true
I20260808 17:50:20.126868 32595 raft_consensus.cc:2454] T 5d25b11fa4224438a334579ce543b369 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cfbf5f8533f42fe94ec5d06911fecf0 in term 0.
I20260808 17:50:20.126909 447 raft_consensus.cc:2781] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:50:20.126946 447 raft_consensus.cc:482] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:50:20.126965 447 raft_consensus.cc:3037] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:20.127628 447 raft_consensus.cc:504] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:20.127733 447 leader_election.cc:288] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 [CANDIDATE]: Term 1 election: Requested vote from peers 14077a91c23640d6883b3b711dd67372 (127.28.213.130:37049), 3eb459959c544f8fa5ef5d8b0bd1ecaf (127.28.213.131:45733)
I20260808 17:50:20.127887 338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d25b11fa4224438a334579ce543b369" candidate_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf"
I20260808 17:50:20.127918 32595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d25b11fa4224438a334579ce543b369" candidate_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14077a91c23640d6883b3b711dd67372"
I20260808 17:50:20.127956 338 raft_consensus.cc:3037] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:20.127981 32595 raft_consensus.cc:3037] T 5d25b11fa4224438a334579ce543b369 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:20.128539 32595 raft_consensus.cc:2454] T 5d25b11fa4224438a334579ce543b369 P 14077a91c23640d6883b3b711dd67372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfbf5f8533f42fe94ec5d06911fecf0 in term 1.
I20260808 17:50:20.128623 338 raft_consensus.cc:2454] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfbf5f8533f42fe94ec5d06911fecf0 in term 1.
I20260808 17:50:20.128737 32264 leader_election.cc:302] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14077a91c23640d6883b3b711dd67372, 3cfbf5f8533f42fe94ec5d06911fecf0; no voters:
I20260808 17:50:20.128857 447 raft_consensus.cc:2781] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:20.129005 447 raft_consensus.cc:686] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 1 LEADER]: Becoming Leader. State: Replica: 3cfbf5f8533f42fe94ec5d06911fecf0, State: Running, Role: LEADER
I20260808 17:50:20.129098 447 consensus_queue.cc:237] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:20.129570 470 tablet_replica.cc:439] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0: TxnStatusTablet state changed. Reason: New leader 3cfbf5f8533f42fe94ec5d06911fecf0. Latest consensus state: current_term: 1 leader_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } } }
I20260808 17:50:20.129658 470 tablet_replica.cc:442] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0: This TxnStatusTablet replica's current role is: LEADER
I20260808 17:50:20.129899 32123 catalog_manager.cc:5495] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cfbf5f8533f42fe94ec5d06911fecf0 (127.28.213.129). New cstate: current_term: 1 leader_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260808 17:50:20.130214 473 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 17:50:20.130316 473 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 17:50:20.150456 433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.147822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40594 (local address 127.28.213.129:32829)
0808 17:50:20.147871 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:20.147873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:20.147880 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:50:20.147944 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:20.147945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:20.147961 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:20.148014 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:20.148146 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.148626 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.149717 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.149891 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.149943 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.150157 (+ 214us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:20.150256 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:20.150332 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:20.150388 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 17:50:20.150407 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:50:20.150518 462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.147741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:32829 (local address 127.0.0.1:40594)
0808 17:50:20.147809 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:20.147821 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:20.147874 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:20.148028 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:20.148029 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:20.148030 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:50:20.148091 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:20.148093 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.148692 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.148693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:20.149648 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:20.149652 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.149959 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.149960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:20.150028 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.150045 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:50:20.150328 (+ 283us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:50:20.150334 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 17:50:20.150384 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 17:50:20.150437 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 17:50:20.152216 338 raft_consensus.cc:1261] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 FOLLOWER]: Refusing update from remote peer 3cfbf5f8533f42fe94ec5d06911fecf0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:20.152232 32595 raft_consensus.cc:1261] T 5d25b11fa4224438a334579ce543b369 P 14077a91c23640d6883b3b711dd67372 [term 1 FOLLOWER]: Refusing update from remote peer 3cfbf5f8533f42fe94ec5d06911fecf0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:20.152513 470 consensus_queue.cc:1035] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:20.152642 447 consensus_queue.cc:1035] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:20.153805 446 tablet_replica.cc:439] T 5d25b11fa4224438a334579ce543b369 P 14077a91c23640d6883b3b711dd67372: TxnStatusTablet state changed. Reason: New leader 3cfbf5f8533f42fe94ec5d06911fecf0. Latest consensus state: current_term: 1 leader_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } } }
I20260808 17:50:20.153795 448 tablet_replica.cc:439] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: TxnStatusTablet state changed. Reason: New leader 3cfbf5f8533f42fe94ec5d06911fecf0. Latest consensus state: current_term: 1 leader_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } } }
I20260808 17:50:20.153885 446 tablet_replica.cc:442] T 5d25b11fa4224438a334579ce543b369 P 14077a91c23640d6883b3b711dd67372: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:20.153885 448 tablet_replica.cc:442] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:20.154835 470 tablet_replica.cc:439] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } } }
I20260808 17:50:20.154932 470 tablet_replica.cc:442] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0: This TxnStatusTablet replica's current role is: LEADER
I20260808 17:50:20.155022 446 tablet_replica.cc:439] T 5d25b11fa4224438a334579ce543b369 P 14077a91c23640d6883b3b711dd67372: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } } }
I20260808 17:50:20.155092 446 tablet_replica.cc:442] T 5d25b11fa4224438a334579ce543b369 P 14077a91c23640d6883b3b711dd67372: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:20.155545 448 tablet_replica.cc:439] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } } }
I20260808 17:50:20.155632 448 tablet_replica.cc:442] T 5d25b11fa4224438a334579ce543b369 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:20.154840 447 tablet_replica.cc:439] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } } }
I20260808 17:50:20.155797 447 tablet_replica.cc:442] T 5d25b11fa4224438a334579ce543b369 P 3cfbf5f8533f42fe94ec5d06911fecf0: This TxnStatusTablet replica's current role is: LEADER
I20260808 17:50:20.155802 482 mvcc.cc:205] Tried to move back new op lower bound from 7316321976941199360 to 7316321976849489920. Current Snapshot: MvccSnapshot[applied={T|T < 7316321976941199360}]
I20260808 17:50:20.160023 434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.157637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39870 (local address 127.28.213.131:45733)
0808 17:50:20.157678 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:20.157679 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:20.157687 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:20.157740 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:20.157741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:20.157755 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:20.157807 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:20.157923 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.158366 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.159398 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.159578 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.159629 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.159784 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:20.159863 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:20.159914 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:20.159964 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 17:50:20.159980 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:50:20.164353 433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.162274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:60443 (local address 127.28.213.129:32829)
0808 17:50:20.162311 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:20.162313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:20.162342 (+ 29us) server_negotiation.cc:407] Connection header received
0808 17:50:20.162398 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:20.162399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:20.162407 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:20.162450 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:20.162564 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.163046 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.163734 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.163931 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.163983 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.164152 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:20.164182 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:20.164225 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:20.164274 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 17:50:20.164293 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:50:20.164373 414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.162225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:32829 (local address 127.28.213.131:60443)
0808 17:50:20.162302 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:20.162311 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:20.162356 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:20.162451 (+ 95us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:20.162451 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:20.162452 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:50:20.162507 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:20.162509 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.163115 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.163116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:20.163662 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:20.163663 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.163990 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.163991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:20.164061 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.164074 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:50:20.164232 (+ 158us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:50:20.164234 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:50:20.164280 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 17:50:20.164316 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 17:50:20.166733 32595 raft_consensus.cc:1261] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372 [term 1 FOLLOWER]: Refusing update from remote peer 3eb459959c544f8fa5ef5d8b0bd1ecaf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:20.166829 32380 raft_consensus.cc:1261] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 1 FOLLOWER]: Refusing update from remote peer 3eb459959c544f8fa5ef5d8b0bd1ecaf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:20.167104 451 consensus_queue.cc:1035] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:20.167230 448 consensus_queue.cc:1035] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:20.168524 483 mvcc.cc:205] Tried to move back new op lower bound from 7316321977001377792 to 7316321976090914816. Current Snapshot: MvccSnapshot[applied={T|T < 7316321977001377792}]
I20260808 17:50:20.168761 481 mvcc.cc:205] Tried to move back new op lower bound from 7316321977001377792 to 7316321976090914816. Current Snapshot: MvccSnapshot[applied={T|T < 7316321977001377792}]
I20260808 17:50:20.182144 434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.179518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:34775 (local address 127.28.213.131:45733)
0808 17:50:20.179559 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:20.179561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:20.179757 (+ 196us) server_negotiation.cc:407] Connection header received
0808 17:50:20.179823 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:20.179824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:20.179833 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:20.179878 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:20.180051 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.180499 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.181593 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.181766 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.181816 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.181977 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:20.181998 (+ 21us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:20.182028 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:20.182080 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 17:50:20.182097 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:50:20.182206 500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.179458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:45733 (local address 127.28.213.129:34775)
0808 17:50:20.179699 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:20.179710 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:20.179767 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:20.179889 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:20.179890 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:20.179891 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:50:20.179956 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:20.179958 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.180563 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.180564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:20.181523 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:20.181526 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.181828 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.181829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:20.181892 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.181911 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:50:20.182032 (+ 121us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:50:20.182033 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 17:50:20.182079 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 17:50:20.182118 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":77,"threads_started":1}
I20260808 17:50:20.189153 32123 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:20.189277 32123 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:20.189999 32123 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f: Sending DeleteTablet for 3 replicas of tablet b2fec0d9188f49758cf7148092d05df6
I20260808 17:50:20.190265 310 tablet_service.cc:1514] Processing DeleteTablet for tablet b2fec0d9188f49758cf7148092d05df6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:20 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:39854
I20260808 17:50:20.190510 32123 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39428:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 17:50:20.190567 32344 tablet_service.cc:1514] Processing DeleteTablet for tablet b2fec0d9188f49758cf7148092d05df6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:20 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:40580
W20260808 17:50:20.190645 32123 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:50:20.190809 32568 tablet_service.cc:1514] Processing DeleteTablet for tablet b2fec0d9188f49758cf7148092d05df6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:20 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:54436
I20260808 17:50:20.190999 504 tablet_replica.cc:330] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: stopping tablet replica
I20260808 17:50:20.191129 504 raft_consensus.cc:2229] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:50:20.191265 504 raft_consensus.cc:2258] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:20.191779 504 ts_tablet_manager.cc:1905] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:20.191985 310 tablet_service.cc:1467] Processing CreateTablet for tablet 06dac7ef134c4f3ea0747b721c25a9d7 (DEFAULT_TABLE table=test-table [id=4c3976604cd74d9d9b972f135ef1744b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:20.192154 310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06dac7ef134c4f3ea0747b721c25a9d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:20.192596 506 tablet_replica.cc:330] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0: stopping tablet replica
I20260808 17:50:20.192687 506 raft_consensus.cc:2229] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:20.192729 506 raft_consensus.cc:2258] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:20.192850 509 tablet_replica.cc:330] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372: stopping tablet replica
I20260808 17:50:20.192932 509 raft_consensus.cc:2229] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:20.192976 509 raft_consensus.cc:2258] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:20.193354 32344 tablet_service.cc:1467] Processing CreateTablet for tablet 06dac7ef134c4f3ea0747b721c25a9d7 (DEFAULT_TABLE table=test-table [id=4c3976604cd74d9d9b972f135ef1744b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:20.193421 506 ts_tablet_manager.cc:1905] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:20.193460 32344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06dac7ef134c4f3ea0747b721c25a9d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:20.194759 32568 tablet_service.cc:1467] Processing CreateTablet for tablet 06dac7ef134c4f3ea0747b721c25a9d7 (DEFAULT_TABLE table=test-table [id=4c3976604cd74d9d9b972f135ef1744b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:20.194862 32568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06dac7ef134c4f3ea0747b721c25a9d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:20.195374 506 ts_tablet_manager.cc:1918] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:50:20.195449 506 log.cc:1196] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/wal/wals/b2fec0d9188f49758cf7148092d05df6
I20260808 17:50:20.195781 509 ts_tablet_manager.cc:1905] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:20.195703 506 ts_tablet_manager.cc:1939] T b2fec0d9188f49758cf7148092d05df6 P 3cfbf5f8533f42fe94ec5d06911fecf0: Deleting consensus metadata
I20260808 17:50:20.196199 438 tablet_bootstrap.cc:492] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0: Bootstrap starting.
I20260808 17:50:20.196455 438 tablet_bootstrap.cc:654] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:20.196460 32110 catalog_manager.cc:4841] TS 3cfbf5f8533f42fe94ec5d06911fecf0 (127.28.213.129:32829): tablet b2fec0d9188f49758cf7148092d05df6 (table test-table [id=ad794d89cfe2441f9c62093153814be0]) successfully deleted
I20260808 17:50:20.196765 439 tablet_bootstrap.cc:492] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372: Bootstrap starting.
I20260808 17:50:20.197170 439 tablet_bootstrap.cc:654] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:20.197259 509 ts_tablet_manager.cc:1918] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:50:20.197325 509 log.cc:1196] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/b2fec0d9188f49758cf7148092d05df6
I20260808 17:50:20.197570 509 ts_tablet_manager.cc:1939] T b2fec0d9188f49758cf7148092d05df6 P 14077a91c23640d6883b3b711dd67372: Deleting consensus metadata
I20260808 17:50:20.197659 438 tablet_bootstrap.cc:492] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0: No bootstrap required, opened a new log
I20260808 17:50:20.197700 438 ts_tablet_manager.cc:1397] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:50:20.197824 438 raft_consensus.cc:348] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:20.197885 438 raft_consensus.cc:374] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:20.197906 438 raft_consensus.cc:729] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfbf5f8533f42fe94ec5d06911fecf0, State: Initialized, Role: FOLLOWER
I20260808 17:50:20.197918 439 tablet_bootstrap.cc:492] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372: No bootstrap required, opened a new log
I20260808 17:50:20.197944 438 consensus_queue.cc:260] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:20.197959 439 ts_tablet_manager.cc:1397] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:20.197990 32105 catalog_manager.cc:4841] TS 14077a91c23640d6883b3b711dd67372 (127.28.213.130:37049): tablet b2fec0d9188f49758cf7148092d05df6 (table test-table [id=ad794d89cfe2441f9c62093153814be0]) successfully deleted
I20260808 17:50:20.198045 438 ts_tablet_manager.cc:1428] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:20.198087 439 raft_consensus.cc:348] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:20.198143 439 raft_consensus.cc:374] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:20.198164 439 raft_consensus.cc:729] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14077a91c23640d6883b3b711dd67372, State: Initialized, Role: FOLLOWER
I20260808 17:50:20.198204 439 consensus_queue.cc:260] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:20.198282 439 ts_tablet_manager.cc:1428] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:20.199199 444 tablet_bootstrap.cc:492] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Bootstrap starting.
I20260808 17:50:20.199630 444 tablet_bootstrap.cc:654] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:20.200698 504 ts_tablet_manager.cc:1918] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:50:20.200778 504 log.cc:1196] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/b2fec0d9188f49758cf7148092d05df6
I20260808 17:50:20.201028 504 ts_tablet_manager.cc:1939] T b2fec0d9188f49758cf7148092d05df6 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Deleting consensus metadata
I20260808 17:50:20.201558 32109 catalog_manager.cc:4841] TS 3eb459959c544f8fa5ef5d8b0bd1ecaf (127.28.213.131:45733): tablet b2fec0d9188f49758cf7148092d05df6 (table test-table [id=ad794d89cfe2441f9c62093153814be0]) successfully deleted
I20260808 17:50:20.204983 444 tablet_bootstrap.cc:492] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: No bootstrap required, opened a new log
I20260808 17:50:20.205035 444 ts_tablet_manager.cc:1397] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20260808 17:50:20.205157 444 raft_consensus.cc:348] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:20.205240 444 raft_consensus.cc:374] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:20.205268 444 raft_consensus.cc:729] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eb459959c544f8fa5ef5d8b0bd1ecaf, State: Initialized, Role: FOLLOWER
I20260808 17:50:20.205308 444 consensus_queue.cc:260] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:20.205394 444 ts_tablet_manager.cc:1428] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:20.209621 446 raft_consensus.cc:482] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:50:20.209693 446 raft_consensus.cc:504] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:20.209972 446 leader_election.cc:288] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cfbf5f8533f42fe94ec5d06911fecf0 (127.28.213.129:32829), 3eb459959c544f8fa5ef5d8b0bd1ecaf (127.28.213.131:45733)
I20260808 17:50:20.213913 434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.210322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:55561 (local address 127.28.213.131:45733)
0808 17:50:20.210359 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:20.210362 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:20.210484 (+ 122us) server_negotiation.cc:407] Connection header received
0808 17:50:20.210579 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:20.210580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:20.210601 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:20.210629 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:20.210838 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.211525 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.212941 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.213506 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.213557 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.213566 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:20.213820 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 17:50:20.213852 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:50:20.213953 433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.210236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:52825 (local address 127.28.213.129:32829)
0808 17:50:20.210274 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:20.210276 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:20.210414 (+ 138us) server_negotiation.cc:407] Connection header received
0808 17:50:20.210507 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:20.210508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:20.210517 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:20.210545 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:20.210732 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.211473 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.212959 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.213524 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.213570 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.213578 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:20.213840 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 17:50:20.213873 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:50:20.214303 515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.210153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:45733 (local address 127.28.213.130:55561)
0808 17:50:20.210422 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:20.210432 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:20.210510 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:20.210689 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:20.210690 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:20.210692 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:20.210762 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:20.210764 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.211628 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.211629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:20.212834 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:20.212837 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.213658 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.213658 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:20.213732 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.213736 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:20.214179 (+ 443us) client_negotiation.cc:240] Negotiation successful
0808 17:50:20.214220 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"mutex_wait_us":11,"thread_start_us":86,"threads_started":1}
I20260808 17:50:20.214519 338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06dac7ef134c4f3ea0747b721c25a9d7" candidate_uuid: "14077a91c23640d6883b3b711dd67372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" is_pre_election: true
I20260808 17:50:20.214602 338 raft_consensus.cc:2454] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14077a91c23640d6883b3b711dd67372 in term 0.
I20260808 17:50:20.214793 514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.210103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:32829 (local address 127.28.213.130:52825)
0808 17:50:20.210357 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:20.210366 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:20.210440 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:20.210601 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:20.210601 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:20.210603 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:20.210666 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:20.210668 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.211568 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.211569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:20.212846 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:20.212849 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.213671 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.213672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:20.213764 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.213768 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:20.214547 (+ 779us) client_negotiation.cc:240] Negotiation successful
0808 17:50:20.214588 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"mutex_wait_us":36,"thread_start_us":55,"threads_started":1}
I20260808 17:50:20.214771 32493 leader_election.cc:302] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14077a91c23640d6883b3b711dd67372, 3eb459959c544f8fa5ef5d8b0bd1ecaf; no voters:
I20260808 17:50:20.215060 446 raft_consensus.cc:2781] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:50:20.215116 446 raft_consensus.cc:482] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:50:20.215135 446 raft_consensus.cc:3037] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:20.215142 32380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06dac7ef134c4f3ea0747b721c25a9d7" candidate_uuid: "14077a91c23640d6883b3b711dd67372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" is_pre_election: true
I20260808 17:50:20.215210 32380 raft_consensus.cc:2454] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14077a91c23640d6883b3b711dd67372 in term 0.
I20260808 17:50:20.215895 446 raft_consensus.cc:504] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:20.216027 446 leader_election.cc:288] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [CANDIDATE]: Term 1 election: Requested vote from peers 3cfbf5f8533f42fe94ec5d06911fecf0 (127.28.213.129:32829), 3eb459959c544f8fa5ef5d8b0bd1ecaf (127.28.213.131:45733)
I20260808 17:50:20.216250 32380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06dac7ef134c4f3ea0747b721c25a9d7" candidate_uuid: "14077a91c23640d6883b3b711dd67372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0"
I20260808 17:50:20.216322 32380 raft_consensus.cc:3037] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:20.216321 338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06dac7ef134c4f3ea0747b721c25a9d7" candidate_uuid: "14077a91c23640d6883b3b711dd67372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf"
I20260808 17:50:20.216385 338 raft_consensus.cc:3037] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:20.217058 32380 raft_consensus.cc:2454] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14077a91c23640d6883b3b711dd67372 in term 1.
I20260808 17:50:20.217059 338 raft_consensus.cc:2454] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14077a91c23640d6883b3b711dd67372 in term 1.
I20260808 17:50:20.217319 32493 leader_election.cc:302] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14077a91c23640d6883b3b711dd67372, 3eb459959c544f8fa5ef5d8b0bd1ecaf; no voters:
I20260808 17:50:20.217461 446 raft_consensus.cc:2781] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:20.217588 446 raft_consensus.cc:686] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [term 1 LEADER]: Becoming Leader. State: Replica: 14077a91c23640d6883b3b711dd67372, State: Running, Role: LEADER
I20260808 17:50:20.217658 446 consensus_queue.cc:237] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:20.218269 32125 catalog_manager.cc:5495] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 14077a91c23640d6883b3b711dd67372 (127.28.213.130). New cstate: current_term: 1 leader_uuid: "14077a91c23640d6883b3b711dd67372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260808 17:50:20.227056 435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.224058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54440 (local address 127.28.213.130:37049)
0808 17:50:20.224092 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:20.224094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:20.224123 (+ 29us) server_negotiation.cc:407] Connection header received
0808 17:50:20.224193 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:20.224194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:20.224213 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:20.224288 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:20.224400 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.225110 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.226196 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.226491 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.226557 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.226723 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:20.226836 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:20.226904 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:20.226969 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 17:50:20.226990 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:50:20.232590 433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.229610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:57035 (local address 127.28.213.129:32829)
0808 17:50:20.229646 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:20.229648 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:20.229788 (+ 140us) server_negotiation.cc:407] Connection header received
0808 17:50:20.229839 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:20.229840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:20.229849 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:20.229901 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:20.230037 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.230724 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.231792 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.232101 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.232165 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.232368 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:20.232399 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:20.232446 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:20.232506 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 17:50:20.232525 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:50:20.232805 525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.229568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:32829 (local address 127.28.213.130:57035)
0808 17:50:20.229720 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:20.229730 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:20.229791 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:20.229913 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:20.229914 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:20.229915 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:50:20.229983 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:20.229985 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.230812 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.230813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:20.231705 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:20.231709 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.232201 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.232202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:20.232271 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.232287 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:50:20.232457 (+ 170us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:50:20.232459 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:50:20.232504 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 17:50:20.232543 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":71,"threads_started":1}
I20260808 17:50:20.234887 338 raft_consensus.cc:1261] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 FOLLOWER]: Refusing update from remote peer 14077a91c23640d6883b3b711dd67372: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:20.234987 32380 raft_consensus.cc:1261] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 1 FOLLOWER]: Refusing update from remote peer 14077a91c23640d6883b3b711dd67372: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:20.235152 516 consensus_queue.cc:1035] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:20.235790 516 consensus_queue.cc:1035] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:20.244082 500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.241135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:37049 (local address 127.28.213.129:55087)
0808 17:50:20.241247 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:20.241257 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:20.241293 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:20.241511 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:20.241512 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:20.241513 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:50:20.241552 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:20.241553 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.242360 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.242362 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:20.243165 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:20.243168 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.243712 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.243713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:20.243770 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.243776 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:50:20.243932 (+ 156us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:50:20.243934 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:50:20.243971 (+ 37us) client_negotiation.cc:240] Negotiation successful
0808 17:50:20.244011 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 17:50:20.244419 435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:20.241358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:55087 (local address 127.28.213.130:37049)
0808 17:50:20.241406 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:20.241408 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:20.241416 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:20.241434 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:20.241435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:20.241444 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:20.241496 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:20.241628 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.242271 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.243266 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:20.243562 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:20.243616 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:20.243846 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:20.243877 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:20.243913 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:20.244326 (+ 413us) server_negotiation.cc:299] Negotiation successful
0808 17:50:20.244347 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
W20260808 17:50:20.244639 482 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 17:50:21.766141 32125 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:21.766240 32125 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:21.767009 32125 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f: Sending DeleteTablet for 3 replicas of tablet 06dac7ef134c4f3ea0747b721c25a9d7
I20260808 17:50:21.767246 32568 tablet_service.cc:1514] Processing DeleteTablet for tablet 06dac7ef134c4f3ea0747b721c25a9d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:21 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:54436
I20260808 17:50:21.767274 32344 tablet_service.cc:1514] Processing DeleteTablet for tablet 06dac7ef134c4f3ea0747b721c25a9d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:21 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:40580
I20260808 17:50:21.767272 310 tablet_service.cc:1514] Processing DeleteTablet for tablet 06dac7ef134c4f3ea0747b721c25a9d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:21 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:39854
I20260808 17:50:21.767459 562 tablet_replica.cc:330] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0: stopping tablet replica
I20260808 17:50:21.767897 561 tablet_replica.cc:330] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372: stopping tablet replica
I20260808 17:50:21.767962 561 raft_consensus.cc:2229] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:50:21.768055 561 raft_consensus.cc:2258] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:21.767513 562 raft_consensus.cc:2229] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:21.768165 562 raft_consensus.cc:2258] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:21.768363 561 ts_tablet_manager.cc:1905] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:21.768363 562 ts_tablet_manager.cc:1905] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:21.769989 565 tablet_replica.cc:330] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: stopping tablet replica
I20260808 17:50:21.770059 565 raft_consensus.cc:2229] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:21.770097 565 raft_consensus.cc:2258] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:21.770031 561 ts_tablet_manager.cc:1918] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 17:50:21.770298 561 log.cc:1196] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/06dac7ef134c4f3ea0747b721c25a9d7
I20260808 17:50:21.770293 565 ts_tablet_manager.cc:1905] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:21.770566 561 ts_tablet_manager.cc:1939] T 06dac7ef134c4f3ea0747b721c25a9d7 P 14077a91c23640d6883b3b711dd67372: Deleting consensus metadata
I20260808 17:50:21.770834 562 ts_tablet_manager.cc:1918] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 17:50:21.770848 32105 catalog_manager.cc:4841] TS 14077a91c23640d6883b3b711dd67372 (127.28.213.130:37049): tablet 06dac7ef134c4f3ea0747b721c25a9d7 (table test-table [id=4c3976604cd74d9d9b972f135ef1744b]) successfully deleted
I20260808 17:50:21.770892 562 log.cc:1196] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/wal/wals/06dac7ef134c4f3ea0747b721c25a9d7
I20260808 17:50:21.771112 562 ts_tablet_manager.cc:1939] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3cfbf5f8533f42fe94ec5d06911fecf0: Deleting consensus metadata
I20260808 17:50:21.771414 32110 catalog_manager.cc:4841] TS 3cfbf5f8533f42fe94ec5d06911fecf0 (127.28.213.129:32829): tablet 06dac7ef134c4f3ea0747b721c25a9d7 (table test-table [id=4c3976604cd74d9d9b972f135ef1744b]) successfully deleted
I20260808 17:50:21.771816 565 ts_tablet_manager.cc:1918] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 17:50:21.771860 565 log.cc:1196] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/06dac7ef134c4f3ea0747b721c25a9d7
I20260808 17:50:21.772008 565 ts_tablet_manager.cc:1939] T 06dac7ef134c4f3ea0747b721c25a9d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Deleting consensus metadata
I20260808 17:50:21.772344 32109 catalog_manager.cc:4841] TS 3eb459959c544f8fa5ef5d8b0bd1ecaf (127.28.213.131:45733): tablet 06dac7ef134c4f3ea0747b721c25a9d7 (table test-table [id=4c3976604cd74d9d9b972f135ef1744b]) successfully deleted
Aug 08 17:50:21 dist-test-slave-bndk krb5kdc[32065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211421, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 17:50:21 dist-test-slave-bndk krb5kdc[32065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211421, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:21.793987 575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:21.784789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39460 (local address 127.28.213.190:38655)
0808 17:50:21.784926 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:21.784928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:21.784936 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:21.784982 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:21.784983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:21.784993 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:21.785048 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:21.785599 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:21.786085 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:21.786737 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:21.786911 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:21.786951 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:21.791721 (+ 4770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:21.791722 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:21.791722 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:21.791729 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:21.792892 (+ 1163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:21.793272 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:21.793274 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:21.793274 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:21.793338 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:21.793507 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:21.793508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:21.793509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:21.793646 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:21.793749 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:21.793812 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 17:50:21.793892 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":81,"threads_started":1}
I20260808 17:50:21.795248 32125 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39460:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:50:21.795379 32125 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:50:21.796612 32344 tablet_service.cc:1467] Processing CreateTablet for tablet 7a64528ae76d43cea88b76e829bbb88c (DEFAULT_TABLE table=test-table [id=33d1c9aca20443ea871344cb2508d6f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:21.796638 310 tablet_service.cc:1467] Processing CreateTablet for tablet 7a64528ae76d43cea88b76e829bbb88c (DEFAULT_TABLE table=test-table [id=33d1c9aca20443ea871344cb2508d6f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:21.796748 310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a64528ae76d43cea88b76e829bbb88c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:21.796754 32344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a64528ae76d43cea88b76e829bbb88c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:21.797799 576 tablet_bootstrap.cc:492] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Bootstrap starting.
I20260808 17:50:21.797792 32568 tablet_service.cc:1467] Processing CreateTablet for tablet 7a64528ae76d43cea88b76e829bbb88c (DEFAULT_TABLE table=test-table [id=33d1c9aca20443ea871344cb2508d6f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:21.797894 32568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a64528ae76d43cea88b76e829bbb88c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:21.798039 577 tablet_bootstrap.cc:492] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0: Bootstrap starting.
I20260808 17:50:21.798090 576 tablet_bootstrap.cc:654] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:21.798354 577 tablet_bootstrap.cc:654] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:21.798691 576 tablet_bootstrap.cc:492] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf: No bootstrap required, opened a new log
I20260808 17:50:21.798745 576 ts_tablet_manager.cc:1397] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:21.798851 576 raft_consensus.cc:348] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:21.798923 576 raft_consensus.cc:374] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:21.798942 576 raft_consensus.cc:729] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eb459959c544f8fa5ef5d8b0bd1ecaf, State: Initialized, Role: FOLLOWER
I20260808 17:50:21.798939 577 tablet_bootstrap.cc:492] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0: No bootstrap required, opened a new log
I20260808 17:50:21.798983 577 ts_tablet_manager.cc:1397] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:21.799010 576 consensus_queue.cc:260] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:21.799161 583 tablet_bootstrap.cc:492] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372: Bootstrap starting.
I20260808 17:50:21.799141 577 raft_consensus.cc:348] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:21.799182 576 ts_tablet_manager.cc:1428] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:21.799209 577 raft_consensus.cc:374] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:21.799229 577 raft_consensus.cc:729] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfbf5f8533f42fe94ec5d06911fecf0, State: Initialized, Role: FOLLOWER
I20260808 17:50:21.799271 577 consensus_queue.cc:260] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:21.799656 583 tablet_bootstrap.cc:654] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:21.799772 577 ts_tablet_manager.cc:1428] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 17:50:21.800326 583 tablet_bootstrap.cc:492] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372: No bootstrap required, opened a new log
I20260808 17:50:21.800369 583 ts_tablet_manager.cc:1397] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:21.800482 583 raft_consensus.cc:348] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:21.800539 583 raft_consensus.cc:374] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:21.800559 583 raft_consensus.cc:729] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14077a91c23640d6883b3b711dd67372, State: Initialized, Role: FOLLOWER
I20260808 17:50:21.800607 583 consensus_queue.cc:260] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:21.800699 583 ts_tablet_manager.cc:1428] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:21.897372 585 raft_consensus.cc:482] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:50:21.897464 585 raft_consensus.cc:504] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:21.897611 585 leader_election.cc:288] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cfbf5f8533f42fe94ec5d06911fecf0 (127.28.213.129:32829), 14077a91c23640d6883b3b711dd67372 (127.28.213.130:37049)
I20260808 17:50:21.897797 32380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a64528ae76d43cea88b76e829bbb88c" candidate_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" is_pre_election: true
I20260808 17:50:21.897814 32595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a64528ae76d43cea88b76e829bbb88c" candidate_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14077a91c23640d6883b3b711dd67372" is_pre_election: true
I20260808 17:50:21.897890 32380 raft_consensus.cc:2454] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eb459959c544f8fa5ef5d8b0bd1ecaf in term 0.
I20260808 17:50:21.897912 32595 raft_consensus.cc:2454] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eb459959c544f8fa5ef5d8b0bd1ecaf in term 0.
I20260808 17:50:21.898039 32714 leader_election.cc:302] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfbf5f8533f42fe94ec5d06911fecf0, 3eb459959c544f8fa5ef5d8b0bd1ecaf; no voters:
I20260808 17:50:21.898144 585 raft_consensus.cc:2781] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:50:21.898183 585 raft_consensus.cc:482] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:50:21.898197 585 raft_consensus.cc:3037] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:21.898864 585 raft_consensus.cc:504] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:21.898995 585 leader_election.cc:288] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [CANDIDATE]: Term 1 election: Requested vote from peers 3cfbf5f8533f42fe94ec5d06911fecf0 (127.28.213.129:32829), 14077a91c23640d6883b3b711dd67372 (127.28.213.130:37049)
I20260808 17:50:21.899133 32595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a64528ae76d43cea88b76e829bbb88c" candidate_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14077a91c23640d6883b3b711dd67372"
I20260808 17:50:21.899148 32380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a64528ae76d43cea88b76e829bbb88c" candidate_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0"
I20260808 17:50:21.899214 32380 raft_consensus.cc:3037] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:21.899206 32595 raft_consensus.cc:3037] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:21.899820 32380 raft_consensus.cc:2454] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eb459959c544f8fa5ef5d8b0bd1ecaf in term 1.
I20260808 17:50:21.899842 32595 raft_consensus.cc:2454] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eb459959c544f8fa5ef5d8b0bd1ecaf in term 1.
I20260808 17:50:21.899986 32711 leader_election.cc:302] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14077a91c23640d6883b3b711dd67372, 3eb459959c544f8fa5ef5d8b0bd1ecaf; no voters:
I20260808 17:50:21.900102 585 raft_consensus.cc:2781] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:21.900246 585 raft_consensus.cc:686] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 LEADER]: Becoming Leader. State: Replica: 3eb459959c544f8fa5ef5d8b0bd1ecaf, State: Running, Role: LEADER
I20260808 17:50:21.900293 585 consensus_queue.cc:237] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:21.900867 32125 catalog_manager.cc:5495] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 3eb459959c544f8fa5ef5d8b0bd1ecaf (127.28.213.131). New cstate: current_term: 1 leader_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } health_report { overall_health: HEALTHY } } }
I20260808 17:50:21.916710 591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:21.914662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39876 (local address 127.28.213.131:45733)
0808 17:50:21.914788 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:21.914789 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:21.914797 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:21.914818 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:21.914819 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:21.914828 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:21.914889 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:21.914992 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:21.915450 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:21.916141 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:21.916344 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:21.916388 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:21.916518 (+ 130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:21.916550 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:21.916585 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:21.916623 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 17:50:21.916642 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":76,"threads_started":1}
I20260808 17:50:21.918604 32380 raft_consensus.cc:1261] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 1 FOLLOWER]: Refusing update from remote peer 3eb459959c544f8fa5ef5d8b0bd1ecaf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:21.918624 32595 raft_consensus.cc:1261] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372 [term 1 FOLLOWER]: Refusing update from remote peer 3eb459959c544f8fa5ef5d8b0bd1ecaf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:21.918859 585 consensus_queue.cc:1035] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:21.918957 587 consensus_queue.cc:1035] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:21.928285 32125 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:21.928359 32125 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:21.928875 32125 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f: Sending DeleteTablet for 3 replicas of tablet 7a64528ae76d43cea88b76e829bbb88c
I20260808 17:50:21.929097 310 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a64528ae76d43cea88b76e829bbb88c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:21 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:39854
I20260808 17:50:21.929103 32344 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a64528ae76d43cea88b76e829bbb88c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:21 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:40580
I20260808 17:50:21.929111 32568 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a64528ae76d43cea88b76e829bbb88c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:21 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:54436
I20260808 17:50:21.929193 561 tablet_replica.cc:330] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372: stopping tablet replica
I20260808 17:50:21.929263 562 tablet_replica.cc:330] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0: stopping tablet replica
I20260808 17:50:21.929324 562 raft_consensus.cc:2229] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:21.929368 562 raft_consensus.cc:2258] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:21.929438 565 tablet_replica.cc:330] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf: stopping tablet replica
I20260808 17:50:21.929502 565 raft_consensus.cc:2229] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:50:21.929428 32125 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39460:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 17:50:21.929556 565 raft_consensus.cc:2258] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 17:50:21.929561 32125 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:50:21.929746 561 raft_consensus.cc:2229] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:21.929795 561 raft_consensus.cc:2258] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:21.929983 565 ts_tablet_manager.cc:1905] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:21.930070 562 ts_tablet_manager.cc:1905] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:21.931129 561 ts_tablet_manager.cc:1905] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:21.931308 565 ts_tablet_manager.cc:1918] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:50:21.931339 562 ts_tablet_manager.cc:1918] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:50:21.931371 565 log.cc:1196] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/7a64528ae76d43cea88b76e829bbb88c
I20260808 17:50:21.931382 562 log.cc:1196] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-0/wal/wals/7a64528ae76d43cea88b76e829bbb88c
I20260808 17:50:21.931586 562 ts_tablet_manager.cc:1939] T 7a64528ae76d43cea88b76e829bbb88c P 3cfbf5f8533f42fe94ec5d06911fecf0: Deleting consensus metadata
I20260808 17:50:21.931586 565 ts_tablet_manager.cc:1939] T 7a64528ae76d43cea88b76e829bbb88c P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Deleting consensus metadata
I20260808 17:50:21.931859 32109 catalog_manager.cc:4841] TS 3eb459959c544f8fa5ef5d8b0bd1ecaf (127.28.213.131:45733): tablet 7a64528ae76d43cea88b76e829bbb88c (table test-table [id=33d1c9aca20443ea871344cb2508d6f9]) successfully deleted
I20260808 17:50:21.931891 32110 catalog_manager.cc:4841] TS 3cfbf5f8533f42fe94ec5d06911fecf0 (127.28.213.129:32829): tablet 7a64528ae76d43cea88b76e829bbb88c (table test-table [id=33d1c9aca20443ea871344cb2508d6f9]) successfully deleted
I20260808 17:50:21.932389 561 ts_tablet_manager.cc:1918] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:50:21.932436 561 log.cc:1196] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/7a64528ae76d43cea88b76e829bbb88c
I20260808 17:50:21.932566 561 ts_tablet_manager.cc:1939] T 7a64528ae76d43cea88b76e829bbb88c P 14077a91c23640d6883b3b711dd67372: Deleting consensus metadata
I20260808 17:50:21.932875 32105 catalog_manager.cc:4841] TS 14077a91c23640d6883b3b711dd67372 (127.28.213.130:37049): tablet 7a64528ae76d43cea88b76e829bbb88c (table test-table [id=33d1c9aca20443ea871344cb2508d6f9]) successfully deleted
I20260808 17:50:21.933288 32344 tablet_service.cc:1467] Processing CreateTablet for tablet 4f6da1ca36cb4f2b82c134b2402f52d7 (DEFAULT_TABLE table=test-table [id=a1215d4f94bb4265806f75bde8d62e4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:21.933317 310 tablet_service.cc:1467] Processing CreateTablet for tablet 4f6da1ca36cb4f2b82c134b2402f52d7 (DEFAULT_TABLE table=test-table [id=a1215d4f94bb4265806f75bde8d62e4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:21.933314 32568 tablet_service.cc:1467] Processing CreateTablet for tablet 4f6da1ca36cb4f2b82c134b2402f52d7 (DEFAULT_TABLE table=test-table [id=a1215d4f94bb4265806f75bde8d62e4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:21.933398 32344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f6da1ca36cb4f2b82c134b2402f52d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:21.933408 310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f6da1ca36cb4f2b82c134b2402f52d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:21.933419 32568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f6da1ca36cb4f2b82c134b2402f52d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:21.934193 583 tablet_bootstrap.cc:492] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372: Bootstrap starting.
I20260808 17:50:21.934485 583 tablet_bootstrap.cc:654] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:21.934523 577 tablet_bootstrap.cc:492] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3cfbf5f8533f42fe94ec5d06911fecf0: Bootstrap starting.
I20260808 17:50:21.934845 577 tablet_bootstrap.cc:654] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3cfbf5f8533f42fe94ec5d06911fecf0: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:21.935058 583 tablet_bootstrap.cc:492] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372: No bootstrap required, opened a new log
I20260808 17:50:21.935079 576 tablet_bootstrap.cc:492] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Bootstrap starting.
I20260808 17:50:21.935097 583 ts_tablet_manager.cc:1397] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:21.935192 583 raft_consensus.cc:348] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:21.935246 583 raft_consensus.cc:374] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:21.935263 583 raft_consensus.cc:729] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14077a91c23640d6883b3b711dd67372, State: Initialized, Role: FOLLOWER
I20260808 17:50:21.935305 583 consensus_queue.cc:260] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:21.935361 576 tablet_bootstrap.cc:654] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:21.935423 583 ts_tablet_manager.cc:1428] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:21.935760 577 tablet_bootstrap.cc:492] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3cfbf5f8533f42fe94ec5d06911fecf0: No bootstrap required, opened a new log
I20260808 17:50:21.935801 577 ts_tablet_manager.cc:1397] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3cfbf5f8533f42fe94ec5d06911fecf0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:21.935894 577 raft_consensus.cc:348] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:21.935954 577 raft_consensus.cc:374] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:21.935972 577 raft_consensus.cc:729] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfbf5f8533f42fe94ec5d06911fecf0, State: Initialized, Role: FOLLOWER
I20260808 17:50:21.935993 576 tablet_bootstrap.cc:492] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: No bootstrap required, opened a new log
I20260808 17:50:21.936009 577 consensus_queue.cc:260] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3cfbf5f8533f42fe94ec5d06911fecf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:21.936036 576 ts_tablet_manager.cc:1397] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260808 17:50:21.936092 577 ts_tablet_manager.cc:1428] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3cfbf5f8533f42fe94ec5d06911fecf0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:21.936159 576 raft_consensus.cc:348] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:21.936228 576 raft_consensus.cc:374] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:21.936249 576 raft_consensus.cc:729] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eb459959c544f8fa5ef5d8b0bd1ecaf, State: Initialized, Role: FOLLOWER
I20260808 17:50:21.936281 576 consensus_queue.cc:260] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:21.936369 576 ts_tablet_manager.cc:1428] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:22.287124 555 raft_consensus.cc:482] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:50:22.287209 555 raft_consensus.cc:504] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:22.287348 555 leader_election.cc:288] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cfbf5f8533f42fe94ec5d06911fecf0 (127.28.213.129:32829), 3eb459959c544f8fa5ef5d8b0bd1ecaf (127.28.213.131:45733)
I20260808 17:50:22.287547 32380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f6da1ca36cb4f2b82c134b2402f52d7" candidate_uuid: "14077a91c23640d6883b3b711dd67372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" is_pre_election: true
I20260808 17:50:22.287559 338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f6da1ca36cb4f2b82c134b2402f52d7" candidate_uuid: "14077a91c23640d6883b3b711dd67372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" is_pre_election: true
I20260808 17:50:22.287645 32380 raft_consensus.cc:2454] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14077a91c23640d6883b3b711dd67372 in term 0.
I20260808 17:50:22.287658 338 raft_consensus.cc:2454] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14077a91c23640d6883b3b711dd67372 in term 0.
I20260808 17:50:22.287822 32493 leader_election.cc:302] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14077a91c23640d6883b3b711dd67372, 3eb459959c544f8fa5ef5d8b0bd1ecaf; no voters:
I20260808 17:50:22.287954 555 raft_consensus.cc:2781] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:50:22.288033 555 raft_consensus.cc:482] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:50:22.288067 555 raft_consensus.cc:3037] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:22.289065 555 raft_consensus.cc:504] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:22.289180 555 leader_election.cc:288] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [CANDIDATE]: Term 1 election: Requested vote from peers 3cfbf5f8533f42fe94ec5d06911fecf0 (127.28.213.129:32829), 3eb459959c544f8fa5ef5d8b0bd1ecaf (127.28.213.131:45733)
I20260808 17:50:22.289372 338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f6da1ca36cb4f2b82c134b2402f52d7" candidate_uuid: "14077a91c23640d6883b3b711dd67372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf"
I20260808 17:50:22.289357 32380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f6da1ca36cb4f2b82c134b2402f52d7" candidate_uuid: "14077a91c23640d6883b3b711dd67372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0"
I20260808 17:50:22.289455 338 raft_consensus.cc:3037] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:22.289464 32380 raft_consensus.cc:3037] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:22.290043 338 raft_consensus.cc:2454] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14077a91c23640d6883b3b711dd67372 in term 1.
I20260808 17:50:22.290063 32380 raft_consensus.cc:2454] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14077a91c23640d6883b3b711dd67372 in term 1.
I20260808 17:50:22.290221 32493 leader_election.cc:302] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 14077a91c23640d6883b3b711dd67372, 3cfbf5f8533f42fe94ec5d06911fecf0, 3eb459959c544f8fa5ef5d8b0bd1ecaf; no voters:
I20260808 17:50:22.290310 555 raft_consensus.cc:2781] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:22.290408 555 raft_consensus.cc:686] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [term 1 LEADER]: Becoming Leader. State: Replica: 14077a91c23640d6883b3b711dd67372, State: Running, Role: LEADER
I20260808 17:50:22.290458 555 consensus_queue.cc:237] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } }
I20260808 17:50:22.291013 32124 catalog_manager.cc:5495] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 14077a91c23640d6883b3b711dd67372 (127.28.213.130). New cstate: current_term: 1 leader_uuid: "14077a91c23640d6883b3b711dd67372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14077a91c23640d6883b3b711dd67372" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260808 17:50:22.375144 605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:22.372934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54450 (local address 127.28.213.130:37049)
0808 17:50:22.373100 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:22.373101 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:22.373108 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:50:22.373128 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:22.373128 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:22.373138 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:22.373193 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:22.373326 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:22.373807 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:22.374503 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:22.374708 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:22.374760 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:22.374889 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:22.374933 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:22.374977 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:22.375036 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 17:50:22.375059 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":92,"threads_started":1}
I20260808 17:50:22.377204 32380 raft_consensus.cc:1261] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3cfbf5f8533f42fe94ec5d06911fecf0 [term 1 FOLLOWER]: Refusing update from remote peer 14077a91c23640d6883b3b711dd67372: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:22.377192 338 raft_consensus.cc:1261] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 FOLLOWER]: Refusing update from remote peer 14077a91c23640d6883b3b711dd67372: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:22.377434 602 consensus_queue.cc:1035] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eb459959c544f8fa5ef5d8b0bd1ecaf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:22.377550 555 consensus_queue.cc:1035] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfbf5f8533f42fe94ec5d06911fecf0" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 17:50:22.381371 537 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 17:50:23.897341 32124 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:23.897441 32124 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:23.898216 32124 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 473aa1cdb3a44230bd58e139912e8c8f: Sending DeleteTablet for 3 replicas of tablet 4f6da1ca36cb4f2b82c134b2402f52d7
I20260808 17:50:23.898451 32342 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f6da1ca36cb4f2b82c134b2402f52d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:23 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:40580
I20260808 17:50:23.898480 310 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f6da1ca36cb4f2b82c134b2402f52d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:23 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:39854
I20260808 17:50:23.898521 32568 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f6da1ca36cb4f2b82c134b2402f52d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:23 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:54436
I20260808 17:50:23.898602 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 32245
I20260808 17:50:23.904785 651 tablet_replica.cc:330] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372: stopping tablet replica
I20260808 17:50:23.904881 651 raft_consensus.cc:2229] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:50:23.904970 651 raft_consensus.cc:2258] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:23.905197 651 ts_tablet_manager.cc:1905] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:23.905692 648 tablet_replica.cc:330] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: stopping tablet replica
I20260808 17:50:23.905767 648 raft_consensus.cc:2229] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:23.905810 648 raft_consensus.cc:2258] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:23.906085 648 ts_tablet_manager.cc:1905] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:23.906730 651 ts_tablet_manager.cc:1918] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 17:50:23.906790 651 log.cc:1196] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/4f6da1ca36cb4f2b82c134b2402f52d7
I20260808 17:50:23.907019 651 ts_tablet_manager.cc:1939] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 14077a91c23640d6883b3b711dd67372: Deleting consensus metadata
I20260808 17:50:23.907373 32105 catalog_manager.cc:4841] TS 14077a91c23640d6883b3b711dd67372 (127.28.213.130:37049): tablet 4f6da1ca36cb4f2b82c134b2402f52d7 (table test-table [id=a1215d4f94bb4265806f75bde8d62e4a]) successfully deleted
I20260808 17:50:23.907938 648 ts_tablet_manager.cc:1918] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 17:50:23.907997 648 log.cc:1196] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/4f6da1ca36cb4f2b82c134b2402f52d7
I20260808 17:50:23.908182 648 ts_tablet_manager.cc:1939] T 4f6da1ca36cb4f2b82c134b2402f52d7 P 3eb459959c544f8fa5ef5d8b0bd1ecaf: Deleting consensus metadata
I20260808 17:50:23.908455 32109 catalog_manager.cc:4841] TS 3eb459959c544f8fa5ef5d8b0bd1ecaf (127.28.213.131:45733): tablet 4f6da1ca36cb4f2b82c134b2402f52d7 (table test-table [id=a1215d4f94bb4265806f75bde8d62e4a]) successfully deleted
W20260808 17:50:23.912815 32110 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.213.129:32829 (error 108)
I20260808 17:50:23.913005 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 32467
I20260808 17:50:23.915294 655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:23.913189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:32829 (local address 127.0.0.1:40600)
0808 17:50:23.915183 (+ 1994us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:23.915250 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.129:32829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1967,"thread_start_us":74,"threads_started":1}
W20260808 17:50:23.915544 32110 catalog_manager.cc:4584] TS 3cfbf5f8533f42fe94ec5d06911fecf0 (127.28.213.129:32829): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4f6da1ca36cb4f2b82c134b2402f52d7: Network error: Client connection negotiation failed: client connection to 127.28.213.129:32829: connect: Connection refused (error 111)
I20260808 17:50:23.925280 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 32685
I20260808 17:50:23.933830 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 32083
2026-08-08T17:50:23Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5957 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:50:23 dist-test-slave-bndk krb5kdc[658](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:50:23 dist-test-slave-bndk krb5kdc[658](info): set up 2 sockets
Aug 08 17:50:23 dist-test-slave-bndk krb5kdc[658](info): commencing operation
krb5kdc: starting...
W20260808 17:50:25.055918 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:50:25 dist-test-slave-bndk krb5kdc[658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211425, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:50:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:50:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:50:25.167454 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:37593
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:44719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:37593
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:25.246025 675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:25.246205 675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:25.246227 675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:25.247272 675 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:25.247304 675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:25.247318 675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:25.247327 675 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:25.247342 675 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:50:25.248803 675 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:44719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:37593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:37593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.675
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:25.248994 675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:25.249157 675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:25.253857 681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:25.253849 680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:25.253916 675 server_base.cc:1034] running on GCE node
W20260808 17:50:25.253846 683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:25.254256 675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:25.254492 675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:25.255621 675 hybrid_clock.cc:648] HybridClock initialized: now 1786211425255607 us; error 31 us; skew 500 ppm
Aug 08 17:50:25 dist-test-slave-bndk krb5kdc[658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211425, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:25.257943 675 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:50:25.258349 675 webserver.cc:460] Webserver started at http://127.28.213.190:35833/ using document root <none> and password file <none>
I20260808 17:50:25.258549 675 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:25.258589 675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:25.258677 675 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:25.259605 675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "c90efb0ad1f742928db47eaca9c79445"
format_stamp: "Formatted at 2026-08-08 17:50:25 on dist-test-slave-bndk"
server_key: "28d007d29772493a2a9c3a073d4ceeac"
server_key_iv: "dffbdeead913036ace7fa0b964c7d577"
server_key_version: "encryptionkey@0"
I20260808 17:50:25.259889 675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "c90efb0ad1f742928db47eaca9c79445"
format_stamp: "Formatted at 2026-08-08 17:50:25 on dist-test-slave-bndk"
server_key: "28d007d29772493a2a9c3a073d4ceeac"
server_key_iv: "dffbdeead913036ace7fa0b964c7d577"
server_key_version: "encryptionkey@0"
I20260808 17:50:25.261050 675 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:50:25.261731 693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:25.261883 675 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:25.261967 675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "c90efb0ad1f742928db47eaca9c79445"
format_stamp: "Formatted at 2026-08-08 17:50:25 on dist-test-slave-bndk"
server_key: "28d007d29772493a2a9c3a073d4ceeac"
server_key_iv: "dffbdeead913036ace7fa0b964c7d577"
server_key_version: "encryptionkey@0"
I20260808 17:50:25.262022 675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:25.271610 675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:25.273113 675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:25.273238 675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:25.276901 675 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:37593
I20260808 17:50:25.276942 773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:37593 every 8 connection(s)
I20260808 17:50:25.277292 675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:50:25.278124 774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:25.280212 774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445: Bootstrap starting.
I20260808 17:50:25.280711 774 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:25.280962 774 log.cc:824] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:25.281323 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 675
I20260808 17:50:25.281415 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:50:25.281580 29526 external_mini_cluster.cc:1428] Setting key 02fa2df8bd58631000b6102d1766c486
I20260808 17:50:25.281652 774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445: No bootstrap required, opened a new log
I20260808 17:50:25.283772 774 raft_consensus.cc:348] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90efb0ad1f742928db47eaca9c79445" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 37593 } }
I20260808 17:50:25.283919 774 raft_consensus.cc:374] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:25.283964 774 raft_consensus.cc:729] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c90efb0ad1f742928db47eaca9c79445, State: Initialized, Role: FOLLOWER
I20260808 17:50:25.284083 774 consensus_queue.cc:260] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90efb0ad1f742928db47eaca9c79445" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 37593 } }
I20260808 17:50:25.284143 774 raft_consensus.cc:388] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:50:25.284173 774 raft_consensus.cc:482] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:50:25.284216 774 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:25.284708 774 raft_consensus.cc:504] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90efb0ad1f742928db47eaca9c79445" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 37593 } }
I20260808 17:50:25.284801 774 leader_election.cc:302] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c90efb0ad1f742928db47eaca9c79445; no voters:
I20260808 17:50:25.284970 774 leader_election.cc:288] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:50:25.285013 782 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:25.285126 782 raft_consensus.cc:686] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445 [term 1 LEADER]: Becoming Leader. State: Replica: c90efb0ad1f742928db47eaca9c79445, State: Running, Role: LEADER
I20260808 17:50:25.285236 774 sys_catalog.cc:564] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:25.285204 782 consensus_queue.cc:237] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90efb0ad1f742928db47eaca9c79445" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 37593 } }
I20260808 17:50:25.285746 784 sys_catalog.cc:455] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c90efb0ad1f742928db47eaca9c79445" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90efb0ad1f742928db47eaca9c79445" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 37593 } } }
I20260808 17:50:25.285842 784 sys_catalog.cc:458] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:25.285758 785 sys_catalog.cc:455] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c90efb0ad1f742928db47eaca9c79445. Latest consensus state: current_term: 1 leader_uuid: "c90efb0ad1f742928db47eaca9c79445" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90efb0ad1f742928db47eaca9c79445" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 37593 } } }
I20260808 17:50:25.286026 785 sys_catalog.cc:458] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:25.286743 792 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:50:25.287397 792 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 17:50:25 dist-test-slave-bndk krb5kdc[658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211425, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:25.289417 792 catalog_manager.cc:1347] Generated new cluster ID: 7d470c8b159c43c78c7de23cef8ad724
I20260808 17:50:25.289472 792 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:50:25.293045 779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:25.282012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40108 (local address 127.28.213.190:37593)
0808 17:50:25.282174 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:25.282182 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:25.282206 (+ 24us) server_negotiation.cc:407] Connection header received
0808 17:50:25.282852 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:25.282858 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:25.282905 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:25.283010 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:25.283767 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:25.284980 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:25.286099 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:25.286693 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:25.286800 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:25.289393 (+ 2593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:25.289397 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:25.289398 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:25.289417 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:25.291235 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:25.291622 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:25.291625 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:25.291626 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:25.291720 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:25.291883 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:25.291884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:25.291884 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:25.292145 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:25.292275 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:25.292737 (+ 462us) server_negotiation.cc:299] Negotiation successful
0808 17:50:25.292858 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":77,"threads_started":1}
I20260808 17:50:25.295321 792 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:50:25.295995 792 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:50:25.302050 792 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c90efb0ad1f742928db47eaca9c79445: Generated new TSK 0
I20260808 17:50:25.302202 792 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
I20260808 17:50:25.325233 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:37593
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:44719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:25.405292 813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:25.405493 813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:25.405522 813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:25.406641 813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:25.406682 813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:25.406724 813 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:50:25.408143 813 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:44719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:37593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:25.408366 813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:25.408574 813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:25.413194 822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:25.413203 824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:25.413203 828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:25.413432 813 server_base.cc:1034] running on GCE node
I20260808 17:50:25.413617 813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:25.413844 813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:25.414978 813 hybrid_clock.cc:648] HybridClock initialized: now 1786211425414964 us; error 28 us; skew 500 ppm
Aug 08 17:50:25 dist-test-slave-bndk krb5kdc[658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211425, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:25.417313 813 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:50:25.417744 813 webserver.cc:460] Webserver started at http://127.28.213.129:45681/ using document root <none> and password file <none>
I20260808 17:50:25.417955 813 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:25.418001 813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:25.418126 813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:25.419108 813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "824f86d4879b4f61b02347b20ea48dd6"
format_stamp: "Formatted at 2026-08-08 17:50:25 on dist-test-slave-bndk"
server_key: "66eba667d4133d980f51b2877add8738"
server_key_iv: "0fbf3ef76df2aa240a94225e2b949a75"
server_key_version: "encryptionkey@0"
I20260808 17:50:25.419441 813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "824f86d4879b4f61b02347b20ea48dd6"
format_stamp: "Formatted at 2026-08-08 17:50:25 on dist-test-slave-bndk"
server_key: "66eba667d4133d980f51b2877add8738"
server_key_iv: "0fbf3ef76df2aa240a94225e2b949a75"
server_key_version: "encryptionkey@0"
I20260808 17:50:25.420626 813 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:50:25.421240 842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:25.421381 813 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:25.421473 813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "824f86d4879b4f61b02347b20ea48dd6"
format_stamp: "Formatted at 2026-08-08 17:50:25 on dist-test-slave-bndk"
server_key: "66eba667d4133d980f51b2877add8738"
server_key_iv: "0fbf3ef76df2aa240a94225e2b949a75"
server_key_version: "encryptionkey@0"
I20260808 17:50:25.421540 813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:25.446798 813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:25.448457 813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:25.448588 813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:25.448789 813 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:25.449065 813 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:25.449098 813 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:25.449124 813 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:25.449142 813 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:25.455178 813 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:33193
I20260808 17:50:25.455219 1023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:33193 every 8 connection(s)
I20260808 17:50:25.455503 813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:50:25.459805 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 813
I20260808 17:50:25.459879 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:50:25.460086 29526 external_mini_cluster.cc:1428] Setting key 4cc18c4dfe3917b2257b98ad50f7ad12
Aug 08 17:50:25 dist-test-slave-bndk krb5kdc[658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211425, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:25.464336 779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:25.456147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:51451 (local address 127.28.213.190:37593)
0808 17:50:25.456191 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:25.456193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:25.456385 (+ 192us) server_negotiation.cc:407] Connection header received
0808 17:50:25.456867 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:25.456868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:25.456881 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:25.456942 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:25.457842 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:25.458352 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:25.459336 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:25.459547 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:25.459603 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:25.461783 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:25.461784 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:25.461785 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:25.461791 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:25.463028 (+ 1237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:25.463398 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:25.463399 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:25.463399 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:25.463494 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:25.463723 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:25.463723 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:25.463724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:25.463855 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:25.463928 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:25.464143 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 17:50:25.464229 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:50:25.464404 1027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:25.456103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:37593 (local address 127.28.213.129:51451)
0808 17:50:25.456271 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:25.456309 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:25.456771 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:25.457013 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:25.457017 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:25.457572 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:25.457747 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:25.457752 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:25.458442 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:25.458443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:25.459248 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:25.459251 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:25.459617 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:25.459618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:25.459741 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:25.460220 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:25.460228 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:25.461696 (+ 1468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:25.463104 (+ 1408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:25.463111 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:25.463113 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:25.463316 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:25.463553 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:25.463554 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:25.463554 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:25.463659 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:25.463914 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:25.463918 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:25.464029 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 17:50:25.464108 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 17:50:25.464242 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":85,"threads_started":1}
I20260808 17:50:25.465008 1024 heartbeater.cc:347] Connected to a master server at 127.28.213.190:37593
I20260808 17:50:25.465111 1024 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:25.465306 1024 heartbeater.cc:511] Master 127.28.213.190:37593 requested a full tablet report, sending...
I20260808 17:50:25.465874 722 ts_manager.cc:194] Registered new tserver with Master: 824f86d4879b4f61b02347b20ea48dd6 (127.28.213.129:33193)
I20260808 17:50:25.466753 722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:51451
WARNING: no policy specified for kudu/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
I20260808 17:50:25.483489 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:37593
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:44719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:25.560940 1031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:25.561123 1031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:25.561144 1031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:25.562265 1031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:25.562304 1031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:25.562332 1031 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:50:25.563716 1031 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:44719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:37593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:25.563920 1031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:25.564133 1031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:25.568750 1040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:25.568759 1039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:25.568866 1031 server_base.cc:1034] running on GCE node
W20260808 17:50:25.568770 1042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:25.569177 1031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:25.569429 1031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:25.570557 1031 hybrid_clock.cc:648] HybridClock initialized: now 1786211425570548 us; error 27 us; skew 500 ppm
Aug 08 17:50:25 dist-test-slave-bndk krb5kdc[658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211425, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:25.572821 1031 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:50:25.573208 1031 webserver.cc:460] Webserver started at http://127.28.213.130:45553/ using document root <none> and password file <none>
I20260808 17:50:25.573423 1031 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:25.573469 1031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:25.573585 1031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:25.574539 1031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "ef40184e6449485b8c7619d88fa59997"
format_stamp: "Formatted at 2026-08-08 17:50:25 on dist-test-slave-bndk"
server_key: "abe582017b5056e7e20ccfc5599c212d"
server_key_iv: "482b72bb592c8ff5ddf9b828c0146588"
server_key_version: "encryptionkey@0"
I20260808 17:50:25.574856 1031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "ef40184e6449485b8c7619d88fa59997"
format_stamp: "Formatted at 2026-08-08 17:50:25 on dist-test-slave-bndk"
server_key: "abe582017b5056e7e20ccfc5599c212d"
server_key_iv: "482b72bb592c8ff5ddf9b828c0146588"
server_key_version: "encryptionkey@0"
I20260808 17:50:25.576066 1031 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:50:25.576679 1055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:25.576807 1031 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:25.576889 1031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "ef40184e6449485b8c7619d88fa59997"
format_stamp: "Formatted at 2026-08-08 17:50:25 on dist-test-slave-bndk"
server_key: "abe582017b5056e7e20ccfc5599c212d"
server_key_iv: "482b72bb592c8ff5ddf9b828c0146588"
server_key_version: "encryptionkey@0"
I20260808 17:50:25.576946 1031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:25.607431 1031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:25.609169 1031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:25.609331 1031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:25.609549 1031 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:25.609854 1031 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:25.609886 1031 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:25.609913 1031 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:25.609931 1031 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:25.615262 1031 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:36353
I20260808 17:50:25.615327 1220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:36353 every 8 connection(s)
I20260808 17:50:25.615593 1031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:50:25.617610 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 1031
I20260808 17:50:25.617694 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:50:25.617857 29526 external_mini_cluster.cc:1428] Setting key 81cfa82b517a7ccdc826e5ef73b60b07
Aug 08 17:50:25 dist-test-slave-bndk krb5kdc[658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211425, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:25.624567 779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:25.616305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:51083 (local address 127.28.213.190:37593)
0808 17:50:25.616393 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:25.616395 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:25.616518 (+ 123us) server_negotiation.cc:407] Connection header received
0808 17:50:25.617023 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:25.617025 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:25.617039 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:25.617091 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:25.618144 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:25.618724 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:25.619684 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:25.619894 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:25.619950 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:25.621963 (+ 2013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:25.621964 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:25.621965 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:25.621972 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:25.623195 (+ 1223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:25.623601 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:25.623603 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:25.623603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:25.623658 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:25.623897 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:25.623898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:25.623899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:25.624074 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:25.624153 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:25.624383 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 17:50:25.624473 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 17:50:25.624648 1223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:25.616222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:37593 (local address 127.28.213.130:51083)
0808 17:50:25.616384 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:25.616432 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:25.616926 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:25.617169 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:25.617173 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:25.617830 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:25.618057 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:25.618063 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:25.618816 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:25.618818 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:25.619602 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:25.619604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:25.619974 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:25.619976 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:25.620099 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:25.620535 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:25.620543 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:25.621876 (+ 1333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:25.623271 (+ 1395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:25.623278 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:25.623280 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:25.623536 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:25.623712 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:25.623713 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:25.623714 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:25.623825 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:25.624143 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:25.624148 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:25.624259 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 17:50:25.624339 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 17:50:25.624468 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":78,"threads_started":1}
I20260808 17:50:25.625092 1221 heartbeater.cc:347] Connected to a master server at 127.28.213.190:37593
I20260808 17:50:25.625178 1221 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:25.625375 1221 heartbeater.cc:511] Master 127.28.213.190:37593 requested a full tablet report, sending...
I20260808 17:50:25.625741 722 ts_manager.cc:194] Registered new tserver with Master: ef40184e6449485b8c7619d88fa59997 (127.28.213.130:36353)
WARNING: no policy specified for kudu/127.28.213.131@KRBTEST.COM; defaulting to no policy
I20260808 17:50:25.626245 722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:51083
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
I20260808 17:50:25.641120 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:37593
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:44719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:25.723999 1226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:25.724169 1226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:25.724189 1226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:25.725337 1226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:25.725375 1226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:25.725400 1226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:50:25.726747 1226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:44719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:37593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:25.726920 1226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:25.727088 1226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:25.731544 1234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:25.731549 1236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:25.731556 1238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:25.731688 1226 server_base.cc:1034] running on GCE node
I20260808 17:50:25.731950 1226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:25.732172 1226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:25.733276 1226 hybrid_clock.cc:648] HybridClock initialized: now 1786211425733256 us; error 27 us; skew 500 ppm
Aug 08 17:50:25 dist-test-slave-bndk krb5kdc[658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211425, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:25.735489 1226 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:50:25.735880 1226 webserver.cc:460] Webserver started at http://127.28.213.131:41253/ using document root <none> and password file <none>
I20260808 17:50:25.736086 1226 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:25.736135 1226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:25.736253 1226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:25.737187 1226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "258edba1f16f484085c59a5d6b01e734"
format_stamp: "Formatted at 2026-08-08 17:50:25 on dist-test-slave-bndk"
server_key: "1afdf668c3aa60c296133e33ac49db43"
server_key_iv: "c47a580a2ac17ab4d1e891c0c4559c21"
server_key_version: "encryptionkey@0"
I20260808 17:50:25.737543 1226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "258edba1f16f484085c59a5d6b01e734"
format_stamp: "Formatted at 2026-08-08 17:50:25 on dist-test-slave-bndk"
server_key: "1afdf668c3aa60c296133e33ac49db43"
server_key_iv: "c47a580a2ac17ab4d1e891c0c4559c21"
server_key_version: "encryptionkey@0"
I20260808 17:50:25.738667 1226 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:25.739274 1246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:25.739415 1226 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:25.739503 1226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "258edba1f16f484085c59a5d6b01e734"
format_stamp: "Formatted at 2026-08-08 17:50:25 on dist-test-slave-bndk"
server_key: "1afdf668c3aa60c296133e33ac49db43"
server_key_iv: "c47a580a2ac17ab4d1e891c0c4559c21"
server_key_version: "encryptionkey@0"
I20260808 17:50:25.739563 1226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:25.777863 1226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:25.779532 1226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:25.779657 1226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:25.779852 1226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:25.780143 1226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:25.780176 1226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:25.780203 1226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:25.780227 1226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:25.785909 1226 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:38543
I20260808 17:50:25.785967 1424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:38543 every 8 connection(s)
I20260808 17:50:25.786286 1226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
Aug 08 17:50:25 dist-test-slave-bndk krb5kdc[658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211425, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:25.794189 779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:25.786941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:50789 (local address 127.28.213.190:37593)
0808 17:50:25.786983 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:25.786985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:25.787188 (+ 203us) server_negotiation.cc:407] Connection header received
0808 17:50:25.787636 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:25.787637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:25.787647 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:25.787691 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:25.788523 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:25.789002 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:25.789939 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:25.790129 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:25.790177 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:25.792075 (+ 1898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:25.792076 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:25.792077 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:25.792082 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:25.793161 (+ 1079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:25.793530 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:25.793531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:25.793531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:25.793577 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:25.793746 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:25.793747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:25.793747 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:25.793838 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:25.793881 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:25.794074 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 17:50:25.794128 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:50:25.794355 1429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:25.786936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:37593 (local address 127.28.213.131:50789)
0808 17:50:25.787088 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:25.787121 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:25.787558 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:25.787749 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:25.787752 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:25.788276 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:25.788458 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:25.788463 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:25.789062 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:25.789063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:25.789870 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:25.789873 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:25.790185 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:25.790186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:25.790275 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:25.790697 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:25.790704 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:25.792007 (+ 1303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:25.793247 (+ 1240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:25.793254 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:25.793256 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:25.793470 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:25.793618 (+ 148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:25.793618 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:25.793619 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:25.793706 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:25.793878 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:25.793881 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:25.793984 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 17:50:25.794059 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 17:50:25.794165 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":87,"threads_started":1}
I20260808 17:50:25.794752 1426 heartbeater.cc:347] Connected to a master server at 127.28.213.190:37593
I20260808 17:50:25.794832 1426 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:25.794998 1426 heartbeater.cc:511] Master 127.28.213.190:37593 requested a full tablet report, sending...
I20260808 17:50:25.795323 722 ts_manager.cc:194] Registered new tserver with Master: 258edba1f16f484085c59a5d6b01e734 (127.28.213.131:38543)
I20260808 17:50:25.795553 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 1226
I20260808 17:50:25.795621 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:50:25.795719 722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:50789
I20260808 17:50:25.795786 29526 external_mini_cluster.cc:1428] Setting key 30d7dc42e9804ae8bc3914198663f169
I20260808 17:50:25.796561 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 17:50:25.807847 779 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:25.807049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40124 (local address 127.28.213.190:37593)
0808 17:50:25.807091 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:25.807093 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:25.807191 (+ 98us) server_negotiation.cc:407] Connection header received
0808 17:50:25.807255 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:25.807256 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:25.807265 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:25.807311 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:25.807792 (+ 481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40124: BlockingRecv error: recv got EOF from 127.0.0.1:40124 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:50:25.808646 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 813
I20260808 17:50:25.819515 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 1031
I20260808 17:50:25.832646 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 1226
I20260808 17:50:25.845597 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 675
2026-08-08T17:50:25Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1913 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:50:25 dist-test-slave-bndk krb5kdc[1445](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:50:25 dist-test-slave-bndk krb5kdc[1445](info): set up 2 sockets
Aug 08 17:50:25 dist-test-slave-bndk krb5kdc[1445](info): commencing operation
krb5kdc: starting...
W20260808 17:50:26.964125 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.094s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:50:27 dist-test-slave-bndk krb5kdc[1445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:50:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:50:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:50:27.070046 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:41783
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:46165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:41783
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:27.148499 1462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:27.148686 1462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:27.148706 1462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:27.149793 1462 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:27.149825 1462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:27.149838 1462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:27.149849 1462 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:27.149866 1462 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:50:27.151319 1462 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:46165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:41783
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:41783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1462
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:27.151501 1462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:27.151674 1462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:27.156383 1468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:27.156450 1471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:27.156388 1467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:27.156608 1462 server_base.cc:1034] running on GCE node
I20260808 17:50:27.156831 1462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:27.157087 1462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:27.158217 1462 hybrid_clock.cc:648] HybridClock initialized: now 1786211427158202 us; error 29 us; skew 500 ppm
Aug 08 17:50:27 dist-test-slave-bndk krb5kdc[1445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211427, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:27.164516 1462 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:50:27.164928 1462 webserver.cc:460] Webserver started at http://127.28.213.190:37157/ using document root <none> and password file <none>
I20260808 17:50:27.165130 1462 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:27.165177 1462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:27.165328 1462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:27.166293 1462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "8538ab6383f54206897a055013e54a23"
format_stamp: "Formatted at 2026-08-08 17:50:27 on dist-test-slave-bndk"
server_key: "246cb8ff21d1c5b13c974bee55f6908e"
server_key_iv: "b9ebf6ee87023422042262f75196dd59"
server_key_version: "encryptionkey@0"
I20260808 17:50:27.166627 1462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "8538ab6383f54206897a055013e54a23"
format_stamp: "Formatted at 2026-08-08 17:50:27 on dist-test-slave-bndk"
server_key: "246cb8ff21d1c5b13c974bee55f6908e"
server_key_iv: "b9ebf6ee87023422042262f75196dd59"
server_key_version: "encryptionkey@0"
I20260808 17:50:27.167812 1462 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:50:27.168460 1485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:27.168604 1462 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:27.168697 1462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "8538ab6383f54206897a055013e54a23"
format_stamp: "Formatted at 2026-08-08 17:50:27 on dist-test-slave-bndk"
server_key: "246cb8ff21d1c5b13c974bee55f6908e"
server_key_iv: "b9ebf6ee87023422042262f75196dd59"
server_key_version: "encryptionkey@0"
I20260808 17:50:27.168758 1462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:27.182618 1462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:27.184544 1462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:27.184672 1462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:27.188403 1462 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:41783
I20260808 17:50:27.188447 1556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:41783 every 8 connection(s)
I20260808 17:50:27.188927 1462 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:50:27.189564 1558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:27.191674 1558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23: Bootstrap starting.
I20260808 17:50:27.192237 1558 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:27.192510 1558 log.cc:824] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:27.193118 1558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23: No bootstrap required, opened a new log
I20260808 17:50:27.194038 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 1462
I20260808 17:50:27.194136 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:50:27.194317 29526 external_mini_cluster.cc:1428] Setting key 0e4692d50bfbef9b16bd61c47fdcbaa4
I20260808 17:50:27.195513 1558 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8538ab6383f54206897a055013e54a23" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41783 } }
I20260808 17:50:27.195657 1558 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:27.195693 1558 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8538ab6383f54206897a055013e54a23, State: Initialized, Role: FOLLOWER
I20260808 17:50:27.195817 1558 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8538ab6383f54206897a055013e54a23" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41783 } }
I20260808 17:50:27.195900 1558 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:50:27.195931 1558 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:50:27.195977 1558 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:27.196585 1558 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8538ab6383f54206897a055013e54a23" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41783 } }
I20260808 17:50:27.196674 1558 leader_election.cc:302] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8538ab6383f54206897a055013e54a23; no voters:
I20260808 17:50:27.196817 1558 leader_election.cc:288] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:50:27.196864 1567 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:27.197005 1567 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23 [term 1 LEADER]: Becoming Leader. State: Replica: 8538ab6383f54206897a055013e54a23, State: Running, Role: LEADER
I20260808 17:50:27.197047 1558 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:27.197090 1567 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8538ab6383f54206897a055013e54a23" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41783 } }
I20260808 17:50:27.197439 1567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8538ab6383f54206897a055013e54a23. Latest consensus state: current_term: 1 leader_uuid: "8538ab6383f54206897a055013e54a23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8538ab6383f54206897a055013e54a23" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41783 } } }
I20260808 17:50:27.197516 1567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:27.197645 1568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8538ab6383f54206897a055013e54a23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8538ab6383f54206897a055013e54a23" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41783 } } }
I20260808 17:50:27.197701 1568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:27.197917 1576 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:50:27.198522 1576 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:50:27.200047 1576 catalog_manager.cc:1347] Generated new cluster ID: 2c60f0d223b54302ab0b543290533f2e
I20260808 17:50:27.200102 1576 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:50:27 dist-test-slave-bndk krb5kdc[1445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:27.205269 1566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:27.194757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50790 (local address 127.28.213.190:41783)
0808 17:50:27.194929 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:27.194937 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:27.194960 (+ 23us) server_negotiation.cc:407] Connection header received
0808 17:50:27.195486 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:27.195492 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:27.195532 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:27.195634 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:27.196422 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:27.197664 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:27.198722 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:27.199189 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:27.199297 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:27.201695 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:27.201699 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:27.201699 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:27.201710 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:27.203467 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:27.203829 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:27.203832 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:27.203833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:27.203938 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:27.204107 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:27.204107 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:27.204108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:27.204366 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:27.204520 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:27.204921 (+ 401us) server_negotiation.cc:299] Negotiation successful
0808 17:50:27.205049 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":67,"threads_started":1}
I20260808 17:50:27.206067 1576 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:50:27.206194 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:50:27.206790 1576 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:50:27.216643 1576 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8538ab6383f54206897a055013e54a23: Generated new TSK 0
I20260808 17:50:27.216815 1576 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:50:27.221366 1566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:27.218124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50798 (local address 127.28.213.190:41783)
0808 17:50:27.218160 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:27.218162 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:27.218320 (+ 158us) server_negotiation.cc:407] Connection header received
0808 17:50:27.218383 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:27.218383 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:27.218393 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:27.218445 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:27.218806 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:27.219281 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:27.220040 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:27.220257 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:27.220312 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:27.220958 (+ 646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:27.220959 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:27.220959 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:50:27.221121 (+ 162us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:27.221136 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:50:27.221142 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:27.221187 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:27.221274 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 17:50:27.221298 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:50:27.223776 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 1462
2026-08-08T17:50:27Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1386 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:50:27 dist-test-slave-bndk krb5kdc[1606](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:50:27 dist-test-slave-bndk krb5kdc[1606](info): set up 2 sockets
Aug 08 17:50:27 dist-test-slave-bndk krb5kdc[1606](info): commencing operation
krb5kdc: starting...
W20260808 17:50:28.345498 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:50:28 dist-test-slave-bndk krb5kdc[1606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211428, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:50:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:50:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:50:28.454224 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:34701
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:42443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:34701
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:28.533126 1636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:28.533349 1636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:28.533375 1636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:28.534462 1636 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:28.534493 1636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:28.534507 1636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:28.534518 1636 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:28.534531 1636 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:50:28.535921 1636 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:42443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:34701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:34701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1636
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:28.536100 1636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:28.536262 1636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:28.540613 1643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:28.540643 1645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:28.540635 1648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:28.540771 1636 server_base.cc:1034] running on GCE node
I20260808 17:50:28.541057 1636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:28.541340 1636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:28.542467 1636 hybrid_clock.cc:648] HybridClock initialized: now 1786211428542458 us; error 27 us; skew 500 ppm
Aug 08 17:50:28 dist-test-slave-bndk krb5kdc[1606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211428, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:28.544716 1636 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:50:28.545114 1636 webserver.cc:460] Webserver started at http://127.28.213.190:34015/ using document root <none> and password file <none>
I20260808 17:50:28.545343 1636 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:28.545392 1636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:28.545529 1636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:28.546482 1636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "2530aef492e54e60b3bbfa31df3d30d5"
format_stamp: "Formatted at 2026-08-08 17:50:28 on dist-test-slave-bndk"
server_key: "f8b365a9061a6fa6e1e330a7bbb21724"
server_key_iv: "f509fb3116fc5790ebb1b700790f3b28"
server_key_version: "encryptionkey@0"
I20260808 17:50:28.546797 1636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "2530aef492e54e60b3bbfa31df3d30d5"
format_stamp: "Formatted at 2026-08-08 17:50:28 on dist-test-slave-bndk"
server_key: "f8b365a9061a6fa6e1e330a7bbb21724"
server_key_iv: "f509fb3116fc5790ebb1b700790f3b28"
server_key_version: "encryptionkey@0"
I20260808 17:50:28.547984 1636 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:50:28.548619 1663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:28.548760 1636 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:28.548841 1636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "2530aef492e54e60b3bbfa31df3d30d5"
format_stamp: "Formatted at 2026-08-08 17:50:28 on dist-test-slave-bndk"
server_key: "f8b365a9061a6fa6e1e330a7bbb21724"
server_key_iv: "f509fb3116fc5790ebb1b700790f3b28"
server_key_version: "encryptionkey@0"
I20260808 17:50:28.548905 1636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:28.556869 1636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:28.558763 1636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:28.558888 1636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:28.562642 1636 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:34701
I20260808 17:50:28.562672 1747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:34701 every 8 connection(s)
I20260808 17:50:28.562970 1636 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:50:28.563845 1749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:28.565996 1749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5: Bootstrap starting.
I20260808 17:50:28.566509 1749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:28.566742 1749 log.cc:824] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:28.567560 1749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5: No bootstrap required, opened a new log
I20260808 17:50:28.568037 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 1636
I20260808 17:50:28.568137 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:50:28.568320 29526 external_mini_cluster.cc:1428] Setting key d2994f832c30458ccbc91a8d91983d0e
I20260808 17:50:28.569855 1749 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2530aef492e54e60b3bbfa31df3d30d5" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 34701 } }
I20260808 17:50:28.570031 1749 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:28.570065 1749 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2530aef492e54e60b3bbfa31df3d30d5, State: Initialized, Role: FOLLOWER
I20260808 17:50:28.570189 1749 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2530aef492e54e60b3bbfa31df3d30d5" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 34701 } }
I20260808 17:50:28.570257 1749 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:50:28.570287 1749 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:50:28.570327 1749 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:28.571434 1749 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2530aef492e54e60b3bbfa31df3d30d5" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 34701 } }
I20260808 17:50:28.571549 1749 leader_election.cc:302] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2530aef492e54e60b3bbfa31df3d30d5; no voters:
I20260808 17:50:28.571702 1749 leader_election.cc:288] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:50:28.571856 1759 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:28.571986 1749 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:28.572026 1759 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5 [term 1 LEADER]: Becoming Leader. State: Replica: 2530aef492e54e60b3bbfa31df3d30d5, State: Running, Role: LEADER
I20260808 17:50:28.573274 1759 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2530aef492e54e60b3bbfa31df3d30d5" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 34701 } }
I20260808 17:50:28.573860 1756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2530aef492e54e60b3bbfa31df3d30d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2530aef492e54e60b3bbfa31df3d30d5" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 34701 } } }
I20260808 17:50:28.573964 1756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5 [sys.catalog]: This master's current role is: LEADER
Aug 08 17:50:28 dist-test-slave-bndk krb5kdc[1606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211428, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:28.574241 1776 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:50:28.574251 1760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2530aef492e54e60b3bbfa31df3d30d5. Latest consensus state: current_term: 1 leader_uuid: "2530aef492e54e60b3bbfa31df3d30d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2530aef492e54e60b3bbfa31df3d30d5" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 34701 } } }
I20260808 17:50:28.578420 1760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:28.579558 1776 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:50:28.581210 1776 catalog_manager.cc:1347] Generated new cluster ID: cf9d8365befc4f9ea095f98aaecff8cc
I20260808 17:50:28.581305 1776 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:50:28.582079 1755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:28.569364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34146 (local address 127.28.213.190:34701)
0808 17:50:28.569542 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:28.569567 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:28.569597 (+ 30us) server_negotiation.cc:407] Connection header received
0808 17:50:28.569794 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:28.569801 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:28.569854 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:28.569984 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:28.570653 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:28.572040 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:28.573069 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:28.573688 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:28.573789 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:28.578052 (+ 4263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:28.578057 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:28.578057 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:28.578068 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:28.579966 (+ 1898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:28.580351 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:28.580354 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:28.580355 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:28.580486 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:28.580821 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:28.580823 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:28.580823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:28.581123 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:28.581287 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:28.581736 (+ 449us) server_negotiation.cc:299] Negotiation successful
0808 17:50:28.581889 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":100,"threads_started":1}
I20260808 17:50:28.595114 1776 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:50:28.595575 1776 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:50:28.597535 1776 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2530aef492e54e60b3bbfa31df3d30d5: Generated new TSK 0
I20260808 17:50:28.597680 1776 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
I20260808 17:50:28.625578 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:34701
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:42443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:28.703552 1786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:28.703734 1786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:28.703755 1786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:28.704843 1786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:28.704883 1786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:28.704916 1786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:50:28.706362 1786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:42443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:34701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:28.706576 1786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:28.706773 1786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 17:50:28.711364 1786 server_base.cc:1034] running on GCE node
W20260808 17:50:28.711378 1799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:28.711341 1797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:28.711349 1801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:28.711728 1786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:28.711930 1786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:28.713056 1786 hybrid_clock.cc:648] HybridClock initialized: now 1786211428713045 us; error 27 us; skew 500 ppm
Aug 08 17:50:28 dist-test-slave-bndk krb5kdc[1606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211428, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:28.715341 1786 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:50:28.715741 1786 webserver.cc:460] Webserver started at http://127.28.213.129:41661/ using document root <none> and password file <none>
I20260808 17:50:28.715932 1786 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:28.715973 1786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:28.716095 1786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:28.717072 1786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "db0252ccaee841e8b0c863cc3276841d"
format_stamp: "Formatted at 2026-08-08 17:50:28 on dist-test-slave-bndk"
server_key: "b50f8044d01ee75a15c2f197069a2907"
server_key_iv: "c2e1ace5c04965b96da78a6a2c3aa940"
server_key_version: "encryptionkey@0"
I20260808 17:50:28.717406 1786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "db0252ccaee841e8b0c863cc3276841d"
format_stamp: "Formatted at 2026-08-08 17:50:28 on dist-test-slave-bndk"
server_key: "b50f8044d01ee75a15c2f197069a2907"
server_key_iv: "c2e1ace5c04965b96da78a6a2c3aa940"
server_key_version: "encryptionkey@0"
I20260808 17:50:28.718585 1786 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:28.719213 1811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:28.719355 1786 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:28.719435 1786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "db0252ccaee841e8b0c863cc3276841d"
format_stamp: "Formatted at 2026-08-08 17:50:28 on dist-test-slave-bndk"
server_key: "b50f8044d01ee75a15c2f197069a2907"
server_key_iv: "c2e1ace5c04965b96da78a6a2c3aa940"
server_key_version: "encryptionkey@0"
I20260808 17:50:28.719498 1786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:28.726285 1786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:28.728164 1786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:28.728288 1786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:28.728469 1786 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:28.728735 1786 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:28.728768 1786 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:28.728794 1786 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:28.728817 1786 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:28.734265 1786 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:44349
I20260808 17:50:28.734330 1995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:44349 every 8 connection(s)
I20260808 17:50:28.734586 1786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:50:28.739552 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 1786
I20260808 17:50:28.739660 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:50:28.739850 29526 external_mini_cluster.cc:1428] Setting key 9f25aa6efa34cd703fe8dbbd2cb0032d
Aug 08 17:50:28 dist-test-slave-bndk krb5kdc[1606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211428, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:28.743287 1755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:28.735192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:32939 (local address 127.28.213.190:34701)
0808 17:50:28.735245 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:28.735247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:28.735413 (+ 166us) server_negotiation.cc:407] Connection header received
0808 17:50:28.735873 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:28.735874 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:28.735891 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:28.735957 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:28.736806 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:28.737362 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:28.738290 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:28.738501 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:28.738558 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:28.740533 (+ 1975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:28.740535 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:28.740535 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:28.740546 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:28.741962 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:28.742454 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:28.742454 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:28.742455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:28.742507 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:28.742751 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:28.742751 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:28.742751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:28.742840 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:28.742884 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:28.743159 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 17:50:28.743226 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 17:50:28.743526 1998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:28.735151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:34701 (local address 127.28.213.129:32939)
0808 17:50:28.735310 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:28.735342 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:28.735785 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:28.736021 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:28.736025 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:28.736545 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:28.736716 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:28.736721 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:28.737445 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:28.737447 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:28.738203 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:28.738205 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:28.738572 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:28.738573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:28.738691 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:28.739042 (+ 351us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:28.739050 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:28.740467 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:28.742052 (+ 1585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:28.742061 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:28.742063 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:28.742380 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:28.742563 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:28.742564 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:28.742564 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:28.742698 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:28.742889 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:28.742894 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:28.743042 (+ 148us) client_negotiation.cc:769] Sending connection context
0808 17:50:28.743150 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 17:50:28.743326 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":84,"threads_started":1}
I20260808 17:50:28.743976 1996 heartbeater.cc:347] Connected to a master server at 127.28.213.190:34701
I20260808 17:50:28.744058 1996 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:28.744215 1996 heartbeater.cc:511] Master 127.28.213.190:34701 requested a full tablet report, sending...
I20260808 17:50:28.744669 1693 ts_manager.cc:194] Registered new tserver with Master: db0252ccaee841e8b0c863cc3276841d (127.28.213.129:44349)
I20260808 17:50:28.745297 1693 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:32939
WARNING: no policy specified for kudu/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
I20260808 17:50:28.763156 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:34701
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:42443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:28.840699 2003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:28.840874 2003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:28.840903 2003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:28.841957 2003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:28.841989 2003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:28.842013 2003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:50:28.843343 2003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:42443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:34701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:28.843503 2003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:28.843665 2003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:28.848095 2012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:28.848122 2003 server_base.cc:1034] running on GCE node
W20260808 17:50:28.848086 2016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:28.848100 2013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:28.848464 2003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:28.848675 2003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:28.849803 2003 hybrid_clock.cc:648] HybridClock initialized: now 1786211428849785 us; error 34 us; skew 500 ppm
Aug 08 17:50:28 dist-test-slave-bndk krb5kdc[1606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211428, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:28.852094 2003 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:50:28.852502 2003 webserver.cc:460] Webserver started at http://127.28.213.130:40809/ using document root <none> and password file <none>
I20260808 17:50:28.852684 2003 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:28.852739 2003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:28.852833 2003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:28.853794 2003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "fb8a2e8fccad4d4387a36482c503efe1"
format_stamp: "Formatted at 2026-08-08 17:50:28 on dist-test-slave-bndk"
server_key: "10237c669df1db425d8db0b82e71ae51"
server_key_iv: "ba3e74db22e0a90e9f22a795990aaecc"
server_key_version: "encryptionkey@0"
I20260808 17:50:28.854086 2003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "fb8a2e8fccad4d4387a36482c503efe1"
format_stamp: "Formatted at 2026-08-08 17:50:28 on dist-test-slave-bndk"
server_key: "10237c669df1db425d8db0b82e71ae51"
server_key_iv: "ba3e74db22e0a90e9f22a795990aaecc"
server_key_version: "encryptionkey@0"
I20260808 17:50:28.855296 2003 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:50:28.855912 2024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:28.856056 2003 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:28.856130 2003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "fb8a2e8fccad4d4387a36482c503efe1"
format_stamp: "Formatted at 2026-08-08 17:50:28 on dist-test-slave-bndk"
server_key: "10237c669df1db425d8db0b82e71ae51"
server_key_iv: "ba3e74db22e0a90e9f22a795990aaecc"
server_key_version: "encryptionkey@0"
I20260808 17:50:28.856192 2003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:28.879206 2003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:28.880831 2003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:28.880942 2003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:28.881148 2003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:28.881475 2003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:28.881510 2003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:28.881529 2003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:28.881552 2003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:28.886807 2003 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:34799
I20260808 17:50:28.886843 2196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:34799 every 8 connection(s)
I20260808 17:50:28.887125 2003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
Aug 08 17:50:28 dist-test-slave-bndk krb5kdc[1606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211428, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:28.895005 1755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:28.887726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:39309 (local address 127.28.213.190:34701)
0808 17:50:28.887805 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:28.887807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:28.887956 (+ 149us) server_negotiation.cc:407] Connection header received
0808 17:50:28.888389 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:28.888390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:28.888400 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:28.888442 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:28.889277 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:28.889771 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:28.890654 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:28.890834 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:28.890877 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:28.892738 (+ 1861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:28.892740 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:28.892740 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:28.892747 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:28.893976 (+ 1229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:28.894316 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:28.894317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:28.894317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:28.894372 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:28.894553 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:28.894553 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:28.894554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:28.894647 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:28.894692 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:28.894878 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 17:50:28.894941 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 17:50:28.895155 2200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:28.887697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:34701 (local address 127.28.213.130:39309)
0808 17:50:28.887846 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:28.887879 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:28.888305 (+ 426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:28.888501 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:28.888504 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:28.889022 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:28.889195 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:28.889199 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:28.889829 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:28.889830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:28.890595 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:28.890597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:28.890884 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:28.890885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:28.890975 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:28.891335 (+ 360us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:28.891343 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:28.892652 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:28.894049 (+ 1397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:28.894054 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:28.894056 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:28.894252 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:28.894425 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:28.894426 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:28.894426 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:28.894512 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:28.894686 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:28.894689 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:28.894787 (+ 98us) client_negotiation.cc:769] Sending connection context
0808 17:50:28.894861 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 17:50:28.894968 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":75,"threads_started":1}
I20260808 17:50:28.895591 2197 heartbeater.cc:347] Connected to a master server at 127.28.213.190:34701
I20260808 17:50:28.895671 2197 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:28.895802 2197 heartbeater.cc:511] Master 127.28.213.190:34701 requested a full tablet report, sending...
I20260808 17:50:28.896171 1693 ts_manager.cc:194] Registered new tserver with Master: fb8a2e8fccad4d4387a36482c503efe1 (127.28.213.130:34799)
I20260808 17:50:28.896497 1693 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:39309
I20260808 17:50:28.897145 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 2003
I20260808 17:50:28.897253 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:50:28.897437 29526 external_mini_cluster.cc:1428] Setting key 3a09564cb7dbf16877a79a92045b847b
WARNING: no policy specified for kudu/127.28.213.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
I20260808 17:50:28.919554 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:34701
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:42443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:28.997079 2205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:28.997275 2205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:28.997298 2205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:28.998355 2205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:28.998391 2205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:28.998422 2205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:50:28.999747 2205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:42443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:34701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:28.999909 2205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:29.000070 2205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:29.004454 2211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:29.004473 2214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:29.004491 2212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:29.004549 2205 server_base.cc:1034] running on GCE node
I20260808 17:50:29.004851 2205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:29.005060 2205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:29.006196 2205 hybrid_clock.cc:648] HybridClock initialized: now 1786211429006168 us; error 45 us; skew 500 ppm
Aug 08 17:50:29 dist-test-slave-bndk krb5kdc[1606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211429, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:29.008497 2205 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:50:29.008881 2205 webserver.cc:460] Webserver started at http://127.28.213.131:43925/ using document root <none> and password file <none>
I20260808 17:50:29.009047 2205 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:29.009085 2205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:29.009174 2205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:29.010116 2205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "f44bee763647401682b3a99ebb37a235"
format_stamp: "Formatted at 2026-08-08 17:50:29 on dist-test-slave-bndk"
server_key: "4111ed959d220941b264e02514bd89f0"
server_key_iv: "895233b5c775d6ef8c0ed269379e90da"
server_key_version: "encryptionkey@0"
I20260808 17:50:29.010396 2205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "f44bee763647401682b3a99ebb37a235"
format_stamp: "Formatted at 2026-08-08 17:50:29 on dist-test-slave-bndk"
server_key: "4111ed959d220941b264e02514bd89f0"
server_key_iv: "895233b5c775d6ef8c0ed269379e90da"
server_key_version: "encryptionkey@0"
I20260808 17:50:29.011516 2205 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:50:29.012207 2225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:29.012370 2205 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:29.012457 2205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "f44bee763647401682b3a99ebb37a235"
format_stamp: "Formatted at 2026-08-08 17:50:29 on dist-test-slave-bndk"
server_key: "4111ed959d220941b264e02514bd89f0"
server_key_iv: "895233b5c775d6ef8c0ed269379e90da"
server_key_version: "encryptionkey@0"
I20260808 17:50:29.012524 2205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:29.024870 2205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:29.026825 2205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:29.026949 2205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:29.027148 2205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:29.027431 2205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:29.027465 2205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:29.027485 2205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:29.027509 2205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:29.032864 2205 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:35469
I20260808 17:50:29.032899 2409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:35469 every 8 connection(s)
I20260808 17:50:29.033169 2205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:50:29.033435 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 2205
I20260808 17:50:29.033537 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:50:29.033733 29526 external_mini_cluster.cc:1428] Setting key 6b3bc7bfb708236b984eca0f3e97a3da
Aug 08 17:50:29 dist-test-slave-bndk krb5kdc[1606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211429, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:29.041587 1755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:29.033985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:49369 (local address 127.28.213.190:34701)
0808 17:50:29.034034 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:29.034036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:29.034291 (+ 255us) server_negotiation.cc:407] Connection header received
0808 17:50:29.034835 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:29.034836 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:29.034847 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:29.034894 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:29.035748 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:29.036228 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:29.037172 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:29.037405 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:29.037458 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:29.039303 (+ 1845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:29.039305 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:29.039305 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:29.039312 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:29.040452 (+ 1140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:29.040796 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:29.040796 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:29.040797 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:29.040849 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:29.041020 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:29.041020 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:29.041020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:29.041112 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:29.041156 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:29.041448 (+ 292us) server_negotiation.cc:299] Negotiation successful
0808 17:50:29.041521 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:50:29.041646 2417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:29.033957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:34701 (local address 127.28.213.131:49369)
0808 17:50:29.034171 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:29.034210 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:29.034738 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:29.034972 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:29.034976 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:29.035492 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:29.035660 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:29.035664 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:29.036308 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:29.036309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:29.037092 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:29.037095 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:29.037481 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:29.037482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:29.037605 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:29.037956 (+ 351us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:29.037963 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:29.039215 (+ 1252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:29.040522 (+ 1307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:29.040529 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:29.040530 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:29.040735 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:29.040891 (+ 156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:29.040892 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:29.040892 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:29.040978 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:29.041153 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:29.041155 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:29.041304 (+ 149us) client_negotiation.cc:769] Sending connection context
0808 17:50:29.041387 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 17:50:29.041499 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":77,"threads_started":1}
I20260808 17:50:29.042066 2412 heartbeater.cc:347] Connected to a master server at 127.28.213.190:34701
I20260808 17:50:29.042153 2412 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:29.042320 2412 heartbeater.cc:511] Master 127.28.213.190:34701 requested a full tablet report, sending...
I20260808 17:50:29.042650 1693 ts_manager.cc:194] Registered new tserver with Master: f44bee763647401682b3a99ebb37a235 (127.28.213.131:35469)
I20260808 17:50:29.042986 1693 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:49369
I20260808 17:50:29.045348 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 17:50:29 dist-test-slave-bndk krb5kdc[1606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211429, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 17:50:29 dist-test-slave-bndk krb5kdc[1606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211429, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:29.067560 1755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:29.061279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34158 (local address 127.28.213.190:34701)
0808 17:50:29.061333 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:29.061335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:29.061432 (+ 97us) server_negotiation.cc:407] Connection header received
0808 17:50:29.061498 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:29.061499 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:29.061509 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:29.061554 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:29.062079 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:29.062544 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:29.063237 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:29.063426 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:29.063479 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:29.065514 (+ 2035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:29.065516 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:29.065516 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:29.065523 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:29.066541 (+ 1018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:29.066834 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:29.066835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:29.066835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:29.066886 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:29.067050 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:29.067050 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:29.067051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:29.067191 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:29.067280 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:29.067388 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 17:50:29.067471 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
W20260808 17:50:29.067772 1693 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:34158
I20260808 17:50:29.068212 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 1786
I20260808 17:50:29.094015 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 2003
I20260808 17:50:29.103214 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 2205
I20260808 17:50:29.117638 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 1636
2026-08-08T17:50:29Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1885 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:50:29 dist-test-slave-bndk krb5kdc[2429](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:50:29 dist-test-slave-bndk krb5kdc[2429](info): set up 2 sockets
Aug 08 17:50:29 dist-test-slave-bndk krb5kdc[2429](info): commencing operation
krb5kdc: starting...
W20260808 17:50:30.251155 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:50:30 dist-test-slave-bndk krb5kdc[2429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:50:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:50:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:50:30.359654 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:42951
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:41925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:42951
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:30.437837 2454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:30.438021 2454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:30.438041 2454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:30.439096 2454 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:30.439129 2454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:30.439142 2454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:30.439153 2454 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:30.439167 2454 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:50:30.440583 2454 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:41925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:42951
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:42951
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:30.440757 2454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:30.440919 2454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:30.445262 2462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:30.445235 2460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:30.445246 2459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:30.445421 2454 server_base.cc:1034] running on GCE node
I20260808 17:50:30.445734 2454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:30.446003 2454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:30.447149 2454 hybrid_clock.cc:648] HybridClock initialized: now 1786211430447135 us; error 29 us; skew 500 ppm
Aug 08 17:50:30 dist-test-slave-bndk krb5kdc[2429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211430, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:30.449465 2454 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:50:30.449877 2454 webserver.cc:460] Webserver started at http://127.28.213.190:42591/ using document root <none> and password file <none>
I20260808 17:50:30.450089 2454 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:30.450136 2454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:30.450260 2454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:30.451206 2454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "35020e16bad04fa1a86bddcc647a43ce"
format_stamp: "Formatted at 2026-08-08 17:50:30 on dist-test-slave-bndk"
server_key: "1321126e694a8582ae55efc1e09b80dd"
server_key_iv: "8a650e18b30969d50b20417ebbbb4f91"
server_key_version: "encryptionkey@0"
I20260808 17:50:30.451555 2454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "35020e16bad04fa1a86bddcc647a43ce"
format_stamp: "Formatted at 2026-08-08 17:50:30 on dist-test-slave-bndk"
server_key: "1321126e694a8582ae55efc1e09b80dd"
server_key_iv: "8a650e18b30969d50b20417ebbbb4f91"
server_key_version: "encryptionkey@0"
I20260808 17:50:30.452730 2454 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:50:30.453394 2471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:30.453555 2454 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:30.453637 2454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "35020e16bad04fa1a86bddcc647a43ce"
format_stamp: "Formatted at 2026-08-08 17:50:30 on dist-test-slave-bndk"
server_key: "1321126e694a8582ae55efc1e09b80dd"
server_key_iv: "8a650e18b30969d50b20417ebbbb4f91"
server_key_version: "encryptionkey@0"
I20260808 17:50:30.453703 2454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:30.467116 2454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:30.469462 2454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:30.469589 2454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:30.473379 2454 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:42951
I20260808 17:50:30.473425 2552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:42951 every 8 connection(s)
I20260808 17:50:30.473855 2454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:50:30.474447 2553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:30.476629 2553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce: Bootstrap starting.
I20260808 17:50:30.477180 2553 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:30.477478 2553 log.cc:824] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:30.478107 2553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce: No bootstrap required, opened a new log
I20260808 17:50:30.479605 2553 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35020e16bad04fa1a86bddcc647a43ce" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 42951 } }
I20260808 17:50:30.479733 2553 raft_consensus.cc:374] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:30.479766 2553 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35020e16bad04fa1a86bddcc647a43ce, State: Initialized, Role: FOLLOWER
I20260808 17:50:30.479895 2553 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35020e16bad04fa1a86bddcc647a43ce" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 42951 } }
I20260808 17:50:30.479962 2553 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:50:30.479993 2553 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:50:30.480038 2553 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:30.480850 2553 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35020e16bad04fa1a86bddcc647a43ce" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 42951 } }
I20260808 17:50:30.480949 2553 leader_election.cc:302] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35020e16bad04fa1a86bddcc647a43ce; no voters:
I20260808 17:50:30.481107 2553 leader_election.cc:288] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:50:30.481148 2558 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:30.481317 2558 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce [term 1 LEADER]: Becoming Leader. State: Replica: 35020e16bad04fa1a86bddcc647a43ce, State: Running, Role: LEADER
I20260808 17:50:30.481354 2553 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:30.481454 2558 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35020e16bad04fa1a86bddcc647a43ce" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 42951 } }
I20260808 17:50:30.481827 2560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "35020e16bad04fa1a86bddcc647a43ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35020e16bad04fa1a86bddcc647a43ce" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 42951 } } }
I20260808 17:50:30.481837 2561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35020e16bad04fa1a86bddcc647a43ce. Latest consensus state: current_term: 1 leader_uuid: "35020e16bad04fa1a86bddcc647a43ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35020e16bad04fa1a86bddcc647a43ce" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 42951 } } }
I20260808 17:50:30.482012 2561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:30.482211 2560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:30.482365 2571 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:50:30.482784 2571 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:50:30.483554 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 2454
I20260808 17:50:30.483659 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:50:30.483848 29526 external_mini_cluster.cc:1428] Setting key 390b38444360afa8847fc5ebcab1aaf7
I20260808 17:50:30.484266 2571 catalog_manager.cc:1347] Generated new cluster ID: 6eb63bd857564a878df2f319be9768d5
I20260808 17:50:30.484318 2571 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:50:30.494993 2571 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:50:30.495442 2571 catalog_manager.cc:1504] Loading token signing keys...
Aug 08 17:50:30 dist-test-slave-bndk krb5kdc[2429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:30.499399 2586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:30.484339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59698 (local address 127.28.213.190:42951)
0808 17:50:30.484505 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:30.484514 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:30.489474 (+ 4960us) server_negotiation.cc:407] Connection header received
0808 17:50:30.489630 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:30.489644 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:30.489716 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:30.489848 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:30.490551 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:30.491905 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:30.492986 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:30.493614 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:30.493706 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:30.496145 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:30.496149 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:30.496150 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:30.496161 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:30.497948 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:30.498327 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:30.498329 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:30.498330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:30.498424 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:30.498609 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:30.498610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:30.498610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:30.498846 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:30.499006 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:30.499074 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 17:50:30.499206 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
I20260808 17:50:30.499874 2571 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 35020e16bad04fa1a86bddcc647a43ce: Generated new TSK 0
I20260808 17:50:30.500028 2571 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
I20260808 17:50:30.527071 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:42951
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:41925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:30.606240 2594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:30.606434 2594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:30.606456 2594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:30.607550 2594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:30.607589 2594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:30.607618 2594 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:50:30.609092 2594 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:41925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:42951
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2594
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:30.609330 2594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:30.609541 2594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:30.614082 2603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:30.614110 2605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:30.614240 2594 server_base.cc:1034] running on GCE node
W20260808 17:50:30.614346 2602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:30.614542 2594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:30.614735 2594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:30.615861 2594 hybrid_clock.cc:648] HybridClock initialized: now 1786211430615851 us; error 26 us; skew 500 ppm
Aug 08 17:50:30 dist-test-slave-bndk krb5kdc[2429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211430, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:30.618227 2594 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:50:30.618618 2594 webserver.cc:460] Webserver started at http://127.28.213.129:40187/ using document root <none> and password file <none>
I20260808 17:50:30.618810 2594 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:30.618855 2594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:30.618979 2594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:30.619937 2594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "81f6b1301de244dfa0c7906377e98bec"
format_stamp: "Formatted at 2026-08-08 17:50:30 on dist-test-slave-bndk"
server_key: "1c0889f327729324a90299cfaaa9d6af"
server_key_iv: "e17f5f2748967f475d0e3f70c1586826"
server_key_version: "encryptionkey@0"
I20260808 17:50:30.620249 2594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "81f6b1301de244dfa0c7906377e98bec"
format_stamp: "Formatted at 2026-08-08 17:50:30 on dist-test-slave-bndk"
server_key: "1c0889f327729324a90299cfaaa9d6af"
server_key_iv: "e17f5f2748967f475d0e3f70c1586826"
server_key_version: "encryptionkey@0"
I20260808 17:50:30.621486 2594 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:50:30.622109 2613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:30.622249 2594 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:30.622329 2594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "81f6b1301de244dfa0c7906377e98bec"
format_stamp: "Formatted at 2026-08-08 17:50:30 on dist-test-slave-bndk"
server_key: "1c0889f327729324a90299cfaaa9d6af"
server_key_iv: "e17f5f2748967f475d0e3f70c1586826"
server_key_version: "encryptionkey@0"
I20260808 17:50:30.622385 2594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:30.648962 2594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:30.650600 2594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:30.650727 2594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:30.650911 2594 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:30.651192 2594 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:30.651232 2594 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:30.651258 2594 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:30.651293 2594 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:30.656684 2594 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:33151
I20260808 17:50:30.656739 2781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:33151 every 8 connection(s)
I20260808 17:50:30.657004 2594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:50:30.661382 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 2594
I20260808 17:50:30.661481 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:50:30.661650 29526 external_mini_cluster.cc:1428] Setting key 3622a3d90d58b90e8328b3e58083fc85
Aug 08 17:50:30 dist-test-slave-bndk krb5kdc[2429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211430, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:30.666055 2586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:30.657661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:35453 (local address 127.28.213.190:42951)
0808 17:50:30.657705 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:30.657707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:30.657894 (+ 187us) server_negotiation.cc:407] Connection header received
0808 17:50:30.658782 (+ 888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:30.658783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:30.658796 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:30.658841 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:30.659424 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:30.659924 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:30.660866 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:30.661080 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:30.661134 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:30.663415 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:30.663416 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:30.663416 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:30.663422 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:30.664777 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:30.665142 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:30.665143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:30.665143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:30.665207 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:30.665490 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:30.665490 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:30.665490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:30.665589 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:30.665639 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:30.665927 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 17:50:30.665995 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:50:30.666249 2784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:30.657642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:42951 (local address 127.28.213.129:35453)
0808 17:50:30.657783 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:30.657817 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:30.658670 (+ 853us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:30.658921 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:30.658925 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:30.659156 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:30.659327 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:30.659330 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:30.660005 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:30.660006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:30.660779 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:30.660781 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:30.661149 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:30.661150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:30.661288 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:30.661727 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:30.661736 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:30.663328 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:30.664862 (+ 1534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:30.664869 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:30.664871 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:30.665078 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:30.665296 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:30.665297 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:30.665297 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:30.665427 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:30.665642 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:30.665648 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:30.665795 (+ 147us) client_negotiation.cc:769] Sending connection context
0808 17:50:30.665905 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 17:50:30.666054 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":68,"threads_started":1}
I20260808 17:50:30.666677 2782 heartbeater.cc:347] Connected to a master server at 127.28.213.190:42951
I20260808 17:50:30.666769 2782 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:30.666927 2782 heartbeater.cc:511] Master 127.28.213.190:42951 requested a full tablet report, sending...
I20260808 17:50:30.667400 2497 ts_manager.cc:194] Registered new tserver with Master: 81f6b1301de244dfa0c7906377e98bec (127.28.213.129:33151)
I20260808 17:50:30.667981 2497 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:35453
WARNING: no policy specified for kudu/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
I20260808 17:50:30.684773 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:42951
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:41925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:30.762692 2787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:30.762867 2787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:30.762889 2787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:30.763978 2787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:30.764017 2787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:30.764050 2787 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:50:30.765527 2787 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:41925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:42951
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:30.765731 2787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:30.765921 2787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:30.770380 2793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:30.770383 2797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:30.770383 2795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:30.770578 2787 server_base.cc:1034] running on GCE node
I20260808 17:50:30.770751 2787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:30.770961 2787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:30.772094 2787 hybrid_clock.cc:648] HybridClock initialized: now 1786211430772076 us; error 27 us; skew 500 ppm
Aug 08 17:50:30 dist-test-slave-bndk krb5kdc[2429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211430, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:30.774359 2787 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:50:30.774734 2787 webserver.cc:460] Webserver started at http://127.28.213.130:38393/ using document root <none> and password file <none>
I20260808 17:50:30.774930 2787 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:30.774986 2787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:30.775146 2787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:30.776089 2787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "e48a752a33ec41f3bcff8cc74bb3c507"
format_stamp: "Formatted at 2026-08-08 17:50:30 on dist-test-slave-bndk"
server_key: "92d84f9a0d0cd30124e563e8becb71d7"
server_key_iv: "662f7a3097c6b37b8ba79c7e5eb505cd"
server_key_version: "encryptionkey@0"
I20260808 17:50:30.776397 2787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "e48a752a33ec41f3bcff8cc74bb3c507"
format_stamp: "Formatted at 2026-08-08 17:50:30 on dist-test-slave-bndk"
server_key: "92d84f9a0d0cd30124e563e8becb71d7"
server_key_iv: "662f7a3097c6b37b8ba79c7e5eb505cd"
server_key_version: "encryptionkey@0"
I20260808 17:50:30.777632 2787 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:50:30.778256 2807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:30.778398 2787 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:30.778477 2787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "e48a752a33ec41f3bcff8cc74bb3c507"
format_stamp: "Formatted at 2026-08-08 17:50:30 on dist-test-slave-bndk"
server_key: "92d84f9a0d0cd30124e563e8becb71d7"
server_key_iv: "662f7a3097c6b37b8ba79c7e5eb505cd"
server_key_version: "encryptionkey@0"
I20260808 17:50:30.778533 2787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:30.785979 2787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:30.787456 2787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:30.787576 2787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:30.787755 2787 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:30.788007 2787 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:30.788041 2787 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:30.788066 2787 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:30.788090 2787 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:30.793524 2787 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:35881
I20260808 17:50:30.793563 2975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:35881 every 8 connection(s)
I20260808 17:50:30.793820 2787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:50:30.798840 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 2787
I20260808 17:50:30.798934 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
Aug 08 17:50:30 dist-test-slave-bndk krb5kdc[2429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211430, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:30.799098 29526 external_mini_cluster.cc:1428] Setting key b8f265b02726f92b0ecf49c294e15bfd
I20260808 17:50:30.802129 2586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:30.794474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:49287 (local address 127.28.213.190:42951)
0808 17:50:30.794520 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:30.794522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:30.794699 (+ 177us) server_negotiation.cc:407] Connection header received
0808 17:50:30.795498 (+ 799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:30.795499 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:30.795509 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:30.795553 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:30.796057 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:30.796527 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:30.797456 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:30.797639 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:30.797681 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:30.799581 (+ 1900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:30.799583 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:30.799583 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:30.799590 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:30.800873 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:30.801253 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:30.801254 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:30.801255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:30.801315 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:30.801577 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:30.801577 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:30.801578 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:30.801678 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:30.801727 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:30.802007 (+ 280us) server_negotiation.cc:299] Negotiation successful
0808 17:50:30.802068 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:50:30.802333 2979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:30.794447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:42951 (local address 127.28.213.130:49287)
0808 17:50:30.794597 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:30.794629 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:30.795424 (+ 795us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:30.795607 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:30.795610 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:30.795827 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:30.795997 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:30.796001 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:30.796583 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:30.796584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:30.797385 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:30.797387 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:30.797688 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:30.797688 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:30.797780 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:30.798151 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:30.798159 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:30.799508 (+ 1349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:30.800958 (+ 1450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:30.800964 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:30.800966 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:30.801164 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:30.801377 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:30.801377 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:30.801378 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:30.801513 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:30.801731 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:30.801736 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:30.801880 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 17:50:30.801992 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 17:50:30.802137 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":79,"threads_started":1}
I20260808 17:50:30.802793 2976 heartbeater.cc:347] Connected to a master server at 127.28.213.190:42951
I20260808 17:50:30.802875 2976 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:30.803027 2976 heartbeater.cc:511] Master 127.28.213.190:42951 requested a full tablet report, sending...
I20260808 17:50:30.803367 2497 ts_manager.cc:194] Registered new tserver with Master: e48a752a33ec41f3bcff8cc74bb3c507 (127.28.213.130:35881)
I20260808 17:50:30.803802 2497 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:49287
WARNING: no policy specified for kudu/127.28.213.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
I20260808 17:50:30.821360 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:42951
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:41925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:30.898940 2983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:30.899123 2983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:30.899153 2983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:30.900246 2983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:30.900285 2983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:30.900319 2983 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:50:30.901777 2983 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:41925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:42951
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:30.901988 2983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:30.902195 2983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:30.906699 2994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:30.906695 2990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:30.906790 2989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:30.906905 2983 server_base.cc:1034] running on GCE node
I20260808 17:50:30.907172 2983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:30.907403 2983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:30.908529 2983 hybrid_clock.cc:648] HybridClock initialized: now 1786211430908519 us; error 26 us; skew 500 ppm
Aug 08 17:50:30 dist-test-slave-bndk krb5kdc[2429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211430, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:30.910882 2983 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:50:30.911257 2983 webserver.cc:460] Webserver started at http://127.28.213.131:39755/ using document root <none> and password file <none>
I20260808 17:50:30.911463 2983 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:30.911509 2983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:30.911629 2983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:30.912567 2983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "e9c261fe6fd744c9941394f6bef0050e"
format_stamp: "Formatted at 2026-08-08 17:50:30 on dist-test-slave-bndk"
server_key: "2ad02df4675786dfca22f4e6334e86c2"
server_key_iv: "c77522907277013fc9ab2df3fb86a6a5"
server_key_version: "encryptionkey@0"
I20260808 17:50:30.912883 2983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "e9c261fe6fd744c9941394f6bef0050e"
format_stamp: "Formatted at 2026-08-08 17:50:30 on dist-test-slave-bndk"
server_key: "2ad02df4675786dfca22f4e6334e86c2"
server_key_iv: "c77522907277013fc9ab2df3fb86a6a5"
server_key_version: "encryptionkey@0"
I20260808 17:50:30.914155 2983 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:50:30.914815 3006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:30.914966 2983 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:30.915045 2983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "e9c261fe6fd744c9941394f6bef0050e"
format_stamp: "Formatted at 2026-08-08 17:50:30 on dist-test-slave-bndk"
server_key: "2ad02df4675786dfca22f4e6334e86c2"
server_key_iv: "c77522907277013fc9ab2df3fb86a6a5"
server_key_version: "encryptionkey@0"
I20260808 17:50:30.915103 2983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:30.930991 2983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:30.932523 2983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:30.932647 2983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:30.932827 2983 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:30.933089 2983 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:30.933121 2983 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:30.933146 2983 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:30.933163 2983 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:30.938300 2983 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:44529
I20260808 17:50:30.938362 3172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:44529 every 8 connection(s)
I20260808 17:50:30.938609 2983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
Aug 08 17:50:30 dist-test-slave-bndk krb5kdc[2429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211430, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:30.945363 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 2983
I20260808 17:50:30.945475 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:50:30.945680 29526 external_mini_cluster.cc:1428] Setting key 00fa07de4d7dacf5e008decc1964ace8
I20260808 17:50:30.946830 2586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:30.939244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:52625 (local address 127.28.213.190:42951)
0808 17:50:30.939306 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:30.939308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:30.939469 (+ 161us) server_negotiation.cc:407] Connection header received
0808 17:50:30.940308 (+ 839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:30.940309 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:30.940318 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:30.940364 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:30.940878 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:30.941419 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:30.942388 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:30.942574 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:30.942616 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:30.944366 (+ 1750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:30.944367 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:30.944368 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:30.944374 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:30.945562 (+ 1188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:30.945973 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:30.945975 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:30.945975 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:30.946036 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:30.946247 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:30.946248 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:30.946248 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:30.946358 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:30.946413 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:30.946665 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 17:50:30.946744 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 17:50:30.946962 3176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:30.939205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:42951 (local address 127.28.213.131:52625)
0808 17:50:30.939359 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:30.939397 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:30.940227 (+ 830us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:30.940424 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:30.940427 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:30.940652 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:30.940820 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:30.940823 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:30.941497 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:30.941498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:30.942323 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:30.942326 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:30.942623 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:30.942623 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:30.942710 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:30.943061 (+ 351us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:30.943069 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:30.944287 (+ 1218us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:30.945636 (+ 1349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:30.945642 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:30.945643 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:30.945906 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:30.946087 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:30.946088 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:30.946088 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:30.946192 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:30.946420 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:30.946426 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:30.946548 (+ 122us) client_negotiation.cc:769] Sending connection context
0808 17:50:30.946631 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 17:50:30.946773 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":76,"threads_started":1}
I20260808 17:50:30.947335 3173 heartbeater.cc:347] Connected to a master server at 127.28.213.190:42951
I20260808 17:50:30.947422 3173 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:30.947579 3173 heartbeater.cc:511] Master 127.28.213.190:42951 requested a full tablet report, sending...
I20260808 17:50:30.947911 2497 ts_manager.cc:194] Registered new tserver with Master: e9c261fe6fd744c9941394f6bef0050e (127.28.213.131:44529)
I20260808 17:50:30.948256 2497 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:52625
I20260808 17:50:30.957084 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 17:50:30 dist-test-slave-bndk krb5kdc[2429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 17:50:30 dist-test-slave-bndk krb5kdc[2429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.129@KRBTEST.COM
I20260808 17:50:30.978792 3182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:30.972302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43884 (local address 127.28.213.129:33151)
0808 17:50:30.972455 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:30.972458 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:30.972468 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:50:30.972491 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:30.972493 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:30.972504 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:30.972565 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:30.973035 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:30.973742 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:30.974414 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:30.974684 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:30.974730 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:30.976574 (+ 1844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:30.976582 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:30.976582 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:30.976588 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:30.977939 (+ 1351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:30.978205 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:30.978207 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:30.978208 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:30.978261 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:30.978380 (+ 119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:30.978381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:30.978381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:30.978489 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:30.978576 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:30.978640 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 17:50:30.978696 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":83,"threads_started":1}
Aug 08 17:50:30 dist-test-slave-bndk krb5kdc[2429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:30.985580 2586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:30.979877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59706 (local address 127.28.213.190:42951)
0808 17:50:30.979933 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:30.979935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:30.979943 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:30.979985 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:30.979985 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:30.979993 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:30.980033 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:30.980416 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:30.980880 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:30.981588 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:30.981795 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:30.981839 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:30.983775 (+ 1936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:30.983776 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:30.983777 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:30.983783 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:30.984752 (+ 969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:30.985014 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:30.985015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:30.985015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:30.985055 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:30.985170 (+ 115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:30.985171 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:30.985171 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:30.985311 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:30.985380 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:30.985467 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 17:50:30.985523 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
W20260808 17:50:30.985754 2497 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59706
I20260808 17:50:30.986063 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 2594
I20260808 17:50:31.006857 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 2787
I20260808 17:50:31.016791 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 2983
I20260808 17:50:31.025770 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 2454
2026-08-08T17:50:31Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1910 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:50:31 dist-test-slave-bndk krb5kdc[3188](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:50:31 dist-test-slave-bndk krb5kdc[3188](info): set up 2 sockets
Aug 08 17:50:31 dist-test-slave-bndk krb5kdc[3188](info): commencing operation
krb5kdc: starting...
W20260808 17:50:32.139700 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.088s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:50:32 dist-test-slave-bndk krb5kdc[3188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:50:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:50:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:50:32.249588 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:38941
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:45839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:38941
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:32.328969 3210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:32.329166 3210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:32.329188 3210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:32.330341 3210 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:32.330382 3210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:32.330395 3210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:32.330407 3210 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:32.330417 3210 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:50:32.331861 3210 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:45839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:38941
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:38941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:32.332052 3210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:32.332223 3210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:32.336674 3221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:32.336707 3217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:32.336683 3218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:32.336833 3210 server_base.cc:1034] running on GCE node
I20260808 17:50:32.337118 3210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:32.337406 3210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:32.338555 3210 hybrid_clock.cc:648] HybridClock initialized: now 1786211432338542 us; error 29 us; skew 500 ppm
Aug 08 17:50:32 dist-test-slave-bndk krb5kdc[3188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211432, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:32.343277 3210 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:50:32.343614 3210 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:32.343667 3210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:32.343792 3210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:32.344782 3210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "6283c375fe244dbf9d441e3ecb19b78d"
format_stamp: "Formatted at 2026-08-08 17:50:32 on dist-test-slave-bndk"
server_key: "4d768a89c226aca9dab911d4f0b550d8"
server_key_iv: "1d3318c79b8bee472382b63517dde27a"
server_key_version: "encryptionkey@0"
I20260808 17:50:32.345126 3210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "6283c375fe244dbf9d441e3ecb19b78d"
format_stamp: "Formatted at 2026-08-08 17:50:32 on dist-test-slave-bndk"
server_key: "4d768a89c226aca9dab911d4f0b550d8"
server_key_iv: "1d3318c79b8bee472382b63517dde27a"
server_key_version: "encryptionkey@0"
I20260808 17:50:32.346331 3210 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:50:32.346982 3234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:32.347131 3210 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:32.347203 3210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "6283c375fe244dbf9d441e3ecb19b78d"
format_stamp: "Formatted at 2026-08-08 17:50:32 on dist-test-slave-bndk"
server_key: "4d768a89c226aca9dab911d4f0b550d8"
server_key_iv: "1d3318c79b8bee472382b63517dde27a"
server_key_version: "encryptionkey@0"
I20260808 17:50:32.347265 3210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:32.359257 3210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:32.361274 3210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:32.361400 3210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:32.365152 3210 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:38941
I20260808 17:50:32.365175 3311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:38941 every 8 connection(s)
I20260808 17:50:32.365440 3210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:50:32.366459 3312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:32.368685 3312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d: Bootstrap starting.
I20260808 17:50:32.369277 3312 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:32.369545 3312 log.cc:824] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:32.370175 3312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d: No bootstrap required, opened a new log
I20260808 17:50:32.371917 3312 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6283c375fe244dbf9d441e3ecb19b78d" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38941 } }
I20260808 17:50:32.372053 3312 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:32.372102 3312 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6283c375fe244dbf9d441e3ecb19b78d, State: Initialized, Role: FOLLOWER
I20260808 17:50:32.372246 3312 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6283c375fe244dbf9d441e3ecb19b78d" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38941 } }
I20260808 17:50:32.372321 3312 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:50:32.372367 3312 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:50:32.372413 3312 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:32.373201 3312 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6283c375fe244dbf9d441e3ecb19b78d" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38941 } }
I20260808 17:50:32.373332 3312 leader_election.cc:302] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6283c375fe244dbf9d441e3ecb19b78d; no voters:
I20260808 17:50:32.373515 3312 leader_election.cc:288] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:50:32.373553 3316 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:32.373692 3316 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d [term 1 LEADER]: Becoming Leader. State: Replica: 6283c375fe244dbf9d441e3ecb19b78d, State: Running, Role: LEADER
I20260808 17:50:32.373781 3316 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6283c375fe244dbf9d441e3ecb19b78d" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38941 } }
I20260808 17:50:32.373807 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 3210
I20260808 17:50:32.373908 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:50:32.374089 29526 external_mini_cluster.cc:1428] Setting key 675ca0a3e80c8683f0933bfeda9f7af2
I20260808 17:50:32.374107 3317 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6283c375fe244dbf9d441e3ecb19b78d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6283c375fe244dbf9d441e3ecb19b78d" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38941 } } }
I20260808 17:50:32.374114 3319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6283c375fe244dbf9d441e3ecb19b78d. Latest consensus state: current_term: 1 leader_uuid: "6283c375fe244dbf9d441e3ecb19b78d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6283c375fe244dbf9d441e3ecb19b78d" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38941 } } }
I20260808 17:50:32.374215 3319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:32.374204 3317 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:32.374727 3312 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:32.374835 3323 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:50:32.375314 3323 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:50:32.376780 3323 catalog_manager.cc:1347] Generated new cluster ID: b93bfd3064d84cc18853b81fbb9efc15
I20260808 17:50:32.376832 3323 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:50:32 dist-test-slave-bndk krb5kdc[3188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:32.385524 3323 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:50:32.386088 3323 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:50:32.386914 3327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:32.374531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51296 (local address 127.28.213.190:38941)
0808 17:50:32.376106 (+ 1575us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:32.376115 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:32.376142 (+ 27us) server_negotiation.cc:407] Connection header received
0808 17:50:32.376251 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:32.376258 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:32.376472 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:32.376611 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:32.377382 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.378777 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.379828 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.380440 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.380529 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:32.383169 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:32.383173 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:32.383173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:32.383185 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:32.385019 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:32.385545 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:32.385548 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:32.385548 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:32.385649 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:32.385859 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:32.385860 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:32.385860 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:32.386114 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:32.386267 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:32.386522 (+ 255us) server_negotiation.cc:299] Negotiation successful
0808 17:50:32.386670 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1532,"thread_start_us":74,"threads_started":1}
I20260808 17:50:32.388621 3323 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d: Generated new TSK 0
I20260808 17:50:32.388761 3323 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
I20260808 17:50:32.413374 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38941
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:45839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:32.493424 3352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:32.493623 3352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:32.493655 3352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:32.494781 3352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:32.494820 3352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:32.494855 3352 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:50:32.496340 3352 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:45839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3352
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:32.496562 3352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:32.496771 3352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:32.501394 3359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:32.501426 3364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:32.501426 3362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:32.501454 3352 server_base.cc:1034] running on GCE node
I20260808 17:50:32.501729 3352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:32.501940 3352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:32.503082 3352 hybrid_clock.cc:648] HybridClock initialized: now 1786211432503063 us; error 29 us; skew 500 ppm
Aug 08 17:50:32 dist-test-slave-bndk krb5kdc[3188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211432, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:32.505537 3352 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:50:32.505841 3352 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:32.505892 3352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:32.505986 3352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:32.506928 3352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "568385111cbc463f8a880e1ef66492b6"
format_stamp: "Formatted at 2026-08-08 17:50:32 on dist-test-slave-bndk"
server_key: "b9c06ab447ad9c8654673d9c578cf68e"
server_key_iv: "f886463017e414b1a6de3f22cda65d06"
server_key_version: "encryptionkey@0"
I20260808 17:50:32.507221 3352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "568385111cbc463f8a880e1ef66492b6"
format_stamp: "Formatted at 2026-08-08 17:50:32 on dist-test-slave-bndk"
server_key: "b9c06ab447ad9c8654673d9c578cf68e"
server_key_iv: "f886463017e414b1a6de3f22cda65d06"
server_key_version: "encryptionkey@0"
I20260808 17:50:32.508417 3352 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:50:32.509043 3374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:32.509191 3352 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:32.509295 3352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "568385111cbc463f8a880e1ef66492b6"
format_stamp: "Formatted at 2026-08-08 17:50:32 on dist-test-slave-bndk"
server_key: "b9c06ab447ad9c8654673d9c578cf68e"
server_key_iv: "f886463017e414b1a6de3f22cda65d06"
server_key_version: "encryptionkey@0"
I20260808 17:50:32.509351 3352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:32.522023 3352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:32.523587 3352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:32.523689 3352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:32.523841 3352 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:32.524116 3352 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:32.524148 3352 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:32.524168 3352 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:32.524190 3352 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:32.529399 3352 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:34157
I20260808 17:50:32.529456 3548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:34157 every 8 connection(s)
I20260808 17:50:32.529677 3352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
Aug 08 17:50:32 dist-test-slave-bndk krb5kdc[3188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211432, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:32.537766 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 3352
I20260808 17:50:32.537864 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:50:32.538024 3327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:32.530311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:41171 (local address 127.28.213.190:38941)
0808 17:50:32.530374 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:32.530376 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:32.530553 (+ 177us) server_negotiation.cc:407] Connection header received
0808 17:50:32.531045 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:32.531047 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:32.531060 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:32.531106 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:32.532021 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.532527 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.533536 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.533745 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.533801 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:32.535683 (+ 1882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:32.535684 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:32.535685 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:32.535692 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:32.536773 (+ 1081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:32.537132 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:32.537133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:32.537133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:32.537190 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:32.537422 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:32.537423 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:32.537424 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:32.537536 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:32.537594 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:32.537841 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 17:50:32.537936 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 17:50:32.538038 29526 external_mini_cluster.cc:1428] Setting key 93ea409e6d87b6ac7e4d17b67da6dca4
I20260808 17:50:32.538223 3553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:32.530283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38941 (local address 127.28.213.129:41171)
0808 17:50:32.530440 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:32.530477 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:32.530939 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:32.531185 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:32.531189 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:32.531454 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:32.531919 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:32.531924 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.532614 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.532615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:32.533447 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:32.533449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.533815 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.533816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:32.533942 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:32.534340 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:32.534348 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:32.535588 (+ 1240us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:32.536854 (+ 1266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:32.536861 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:32.536863 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:32.537066 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:32.537262 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:32.537263 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:32.537264 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:32.537365 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:32.537591 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:32.537599 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:32.537723 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 17:50:32.537810 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 17:50:32.537967 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":74,"threads_started":1}
I20260808 17:50:32.538638 3550 heartbeater.cc:347] Connected to a master server at 127.28.213.190:38941
I20260808 17:50:32.538733 3550 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:32.538877 3550 heartbeater.cc:511] Master 127.28.213.190:38941 requested a full tablet report, sending...
I20260808 17:50:32.539358 3263 ts_manager.cc:194] Registered new tserver with Master: 568385111cbc463f8a880e1ef66492b6 (127.28.213.129:34157)
I20260808 17:50:32.539927 3263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:41171
WARNING: no policy specified for kudu/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
I20260808 17:50:32.561676 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38941
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:45839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:32.640592 3556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:32.640776 3556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:32.640798 3556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:32.641930 3556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:32.641968 3556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:32.641993 3556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:50:32.643450 3556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:45839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:32.643646 3556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:32.643855 3556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:32.648340 3564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:32.648341 3571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:32.648383 3568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:32.648638 3556 server_base.cc:1034] running on GCE node
I20260808 17:50:32.648840 3556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:32.649036 3556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:32.650163 3556 hybrid_clock.cc:648] HybridClock initialized: now 1786211432650150 us; error 31 us; skew 500 ppm
Aug 08 17:50:32 dist-test-slave-bndk krb5kdc[3188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211432, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:32.652623 3556 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:50:32.652897 3556 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:32.652941 3556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:32.653033 3556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:32.653981 3556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "a3edffe6dffb400580e48adf93e2bc82"
format_stamp: "Formatted at 2026-08-08 17:50:32 on dist-test-slave-bndk"
server_key: "6e9ffcf51c87b5062bbf1937fecd40f3"
server_key_iv: "295c8d2cdf78b1fe41a3bd078db170f5"
server_key_version: "encryptionkey@0"
I20260808 17:50:32.654266 3556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "a3edffe6dffb400580e48adf93e2bc82"
format_stamp: "Formatted at 2026-08-08 17:50:32 on dist-test-slave-bndk"
server_key: "6e9ffcf51c87b5062bbf1937fecd40f3"
server_key_iv: "295c8d2cdf78b1fe41a3bd078db170f5"
server_key_version: "encryptionkey@0"
I20260808 17:50:32.655364 3556 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:50:32.655985 3579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:32.656132 3556 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:32.656212 3556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "a3edffe6dffb400580e48adf93e2bc82"
format_stamp: "Formatted at 2026-08-08 17:50:32 on dist-test-slave-bndk"
server_key: "6e9ffcf51c87b5062bbf1937fecd40f3"
server_key_iv: "295c8d2cdf78b1fe41a3bd078db170f5"
server_key_version: "encryptionkey@0"
I20260808 17:50:32.656270 3556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:32.684522 3556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:32.686173 3556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:32.686290 3556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:32.686487 3556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:32.686757 3556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:32.686790 3556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:32.686810 3556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:32.686833 3556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:32.692152 3556 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:45599
I20260808 17:50:32.692215 3762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:45599 every 8 connection(s)
I20260808 17:50:32.692407 3556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:50:32.695887 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 3556
I20260808 17:50:32.695982 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:50:32.696171 29526 external_mini_cluster.cc:1428] Setting key 44b5d6df36ad9f2c0195331dd4e76ad9
Aug 08 17:50:32 dist-test-slave-bndk krb5kdc[3188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211432, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:32.701030 3327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:32.693024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:42569 (local address 127.28.213.190:38941)
0808 17:50:32.693075 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:32.693077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:32.693261 (+ 184us) server_negotiation.cc:407] Connection header received
0808 17:50:32.693697 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:32.693698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:32.693708 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:32.693756 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:32.694545 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.695020 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.695933 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.696217 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.696287 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:32.698478 (+ 2191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:32.698480 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:32.698480 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:32.698488 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:32.699814 (+ 1326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:32.700235 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:32.700236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:32.700236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:32.700284 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:32.700508 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:32.700509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:32.700509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:32.700598 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:32.700642 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:32.700912 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 17:50:32.700968 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:50:32.701323 3765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:32.693001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38941 (local address 127.28.213.130:42569)
0808 17:50:32.693143 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:32.693176 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:32.693625 (+ 449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:32.693805 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:32.693808 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:32.694041 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:32.694477 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:32.694482 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.695077 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.695078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:32.695840 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:32.695842 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.696293 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.696294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:32.696438 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:32.696889 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:32.696898 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:32.698376 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:32.699893 (+ 1517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:32.699900 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:32.699902 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:32.700171 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:32.700332 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:32.700333 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:32.700333 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:32.700458 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:32.700646 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:32.700651 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:32.700793 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 17:50:32.700894 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 17:50:32.701076 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":81,"threads_started":1}
I20260808 17:50:32.701742 3763 heartbeater.cc:347] Connected to a master server at 127.28.213.190:38941
I20260808 17:50:32.701831 3763 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:32.701963 3763 heartbeater.cc:511] Master 127.28.213.190:38941 requested a full tablet report, sending...
I20260808 17:50:32.702320 3263 ts_manager.cc:194] Registered new tserver with Master: a3edffe6dffb400580e48adf93e2bc82 (127.28.213.130:45599)
I20260808 17:50:32.702677 3263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:42569
WARNING: no policy specified for kudu/127.28.213.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
I20260808 17:50:32.719875 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38941
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:45839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:32.798780 3773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:32.798969 3773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:32.799001 3773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:32.800114 3773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:32.800153 3773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:32.800189 3773 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:50:32.801687 3773 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:45839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:32.801914 3773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:32.802120 3773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:32.806612 3781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:32.806617 3779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:32.806710 3778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:32.806842 3773 server_base.cc:1034] running on GCE node
I20260808 17:50:32.807044 3773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:32.807246 3773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:32.808382 3773 hybrid_clock.cc:648] HybridClock initialized: now 1786211432808358 us; error 39 us; skew 500 ppm
Aug 08 17:50:32 dist-test-slave-bndk krb5kdc[3188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211432, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:32.810719 3773 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:50:32.811031 3773 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:32.811084 3773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:32.811208 3773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:32.812196 3773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "de6c61e5ba6d4027ad57424a4d15c0b2"
format_stamp: "Formatted at 2026-08-08 17:50:32 on dist-test-slave-bndk"
server_key: "93d65975d52cb37b901848ed490d607b"
server_key_iv: "0ced81b5dc34ad1c30f35b0c49187b4d"
server_key_version: "encryptionkey@0"
I20260808 17:50:32.812522 3773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "de6c61e5ba6d4027ad57424a4d15c0b2"
format_stamp: "Formatted at 2026-08-08 17:50:32 on dist-test-slave-bndk"
server_key: "93d65975d52cb37b901848ed490d607b"
server_key_iv: "0ced81b5dc34ad1c30f35b0c49187b4d"
server_key_version: "encryptionkey@0"
I20260808 17:50:32.813767 3773 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:50:32.814389 3794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:32.814534 3773 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:32.814616 3773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "de6c61e5ba6d4027ad57424a4d15c0b2"
format_stamp: "Formatted at 2026-08-08 17:50:32 on dist-test-slave-bndk"
server_key: "93d65975d52cb37b901848ed490d607b"
server_key_iv: "0ced81b5dc34ad1c30f35b0c49187b4d"
server_key_version: "encryptionkey@0"
I20260808 17:50:32.814672 3773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:32.825476 3773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:32.827371 3773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:32.827502 3773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:32.827682 3773 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:32.827952 3773 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:32.827991 3773 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:32.828019 3773 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:32.828042 3773 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:32.833504 3773 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:39331
I20260808 17:50:32.833539 3974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:39331 every 8 connection(s)
I20260808 17:50:32.833765 3773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
Aug 08 17:50:32 dist-test-slave-bndk krb5kdc[3188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211432, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:32.841370 3327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:32.834380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:51819 (local address 127.28.213.190:38941)
0808 17:50:32.834447 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:32.834449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:32.834630 (+ 181us) server_negotiation.cc:407] Connection header received
0808 17:50:32.835067 (+ 437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:32.835068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:32.835078 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:32.835130 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:32.835928 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.836405 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.837343 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.837523 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.837569 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:32.839333 (+ 1764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:32.839334 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:32.839334 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:32.839340 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:32.840356 (+ 1016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:32.840677 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:32.840677 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:32.840678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:32.840720 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:32.840886 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:32.840887 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:32.840887 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:32.840982 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:32.841026 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:32.841236 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 17:50:32.841308 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 17:50:32.841528 3978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:32.834348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38941 (local address 127.28.213.131:51819)
0808 17:50:32.834513 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:32.834553 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:32.834994 (+ 441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:32.835181 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:32.835184 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:32.835422 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:32.835857 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:32.835863 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.836463 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.836464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:32.837272 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:32.837275 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.837576 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.837577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:32.837667 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:32.838016 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:32.838024 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:32.839254 (+ 1230us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:32.840417 (+ 1163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:32.840423 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:32.840424 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:32.840622 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:32.840762 (+ 140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:32.840763 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:32.840763 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:32.840846 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:32.841022 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:32.841025 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:32.841122 (+ 97us) client_negotiation.cc:769] Sending connection context
0808 17:50:32.841193 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 17:50:32.841341 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":96,"threads_started":1}
I20260808 17:50:32.841941 3976 heartbeater.cc:347] Connected to a master server at 127.28.213.190:38941
I20260808 17:50:32.842024 3976 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:32.842156 3976 heartbeater.cc:511] Master 127.28.213.190:38941 requested a full tablet report, sending...
I20260808 17:50:32.842489 3263 ts_manager.cc:194] Registered new tserver with Master: de6c61e5ba6d4027ad57424a4d15c0b2 (127.28.213.131:39331)
I20260808 17:50:32.842813 3263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:51819
I20260808 17:50:32.843894 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 3773
I20260808 17:50:32.843988 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:50:32.844128 29526 external_mini_cluster.cc:1428] Setting key b9fc735fff069951ba3262c763274a51
I20260808 17:50:32.844832 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:50:32.851056 3327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:32.846041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51298 (local address 127.28.213.190:38941)
0808 17:50:32.846099 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:32.846101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:32.846154 (+ 53us) server_negotiation.cc:407] Connection header received
0808 17:50:32.846207 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:32.846208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:32.846216 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:32.846257 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:32.846736 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.847172 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.847830 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.848001 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.848043 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:32.849009 (+ 966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:32.849011 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:32.849011 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:32.849017 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:32.850219 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:32.850515 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:32.850516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:32.850516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:32.850563 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:32.850678 (+ 115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:32.850678 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:32.850678 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:32.850800 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:32.850865 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:32.850944 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 17:50:32.850998 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 17:50:32.852499 3263 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51298:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:50:32.854063 3263 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:50:32.860088 3990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:32.856207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52692 (local address 127.28.213.131:39331)
0808 17:50:32.856371 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:32.856376 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:32.856438 (+ 62us) server_negotiation.cc:407] Connection header received
0808 17:50:32.856556 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:32.856558 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:32.856572 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:32.856622 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:32.856831 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.857630 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.858908 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.859604 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.859654 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:32.859705 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:32.859972 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 17:50:32.860013 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":79,"threads_started":1}
I20260808 17:50:32.860077 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:32.856121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:39331 (local address 127.0.0.1:52692)
0808 17:50:32.856357 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:32.856367 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:32.856467 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:32.856710 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:32.856711 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:32.856713 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:32.856772 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:32.856774 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.857719 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.857720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:32.858780 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:32.858782 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.859787 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.859788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:32.859866 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:32.859880 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 17:50:32.859945 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 17:50:32.859995 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"mutex_wait_us":61,"thread_start_us":50,"threads_started":1}
I20260808 17:50:32.860088 3986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:32.855922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:45599 (local address 127.0.0.1:46448)
0808 17:50:32.856052 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:32.856091 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:32.856162 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:32.856600 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:32.856603 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:32.856605 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:32.856684 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:32.856686 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.857779 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.857780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:32.858994 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:32.858996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.859886 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.859887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:32.859952 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:32.859955 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:50:32.859982 (+ 27us) client_negotiation.cc:240] Negotiation successful
0808 17:50:32.860010 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"mutex_wait_us":29,"thread_start_us":72,"threads_started":1}
I20260808 17:50:32.860375 3988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:32.856059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46448 (local address 127.28.213.130:45599)
0808 17:50:32.856401 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:32.856406 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:32.856416 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:50:32.856458 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:32.856460 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:32.856476 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:32.856592 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:32.856854 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.857677 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.859054 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.859799 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.860186 (+ 387us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:32.860250 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:32.860276 (+ 26us) server_negotiation.cc:299] Negotiation successful
0808 17:50:32.860314 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":84,"threads_started":1}
I20260808 17:50:32.860737 3991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:32.856251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:34157 (local address 127.0.0.1:46950)
0808 17:50:32.856434 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:32.856444 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:32.856493 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:32.856710 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:32.856711 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:32.856716 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:32.856772 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:32.856773 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.858924 (+ 2151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.858925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:32.859650 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:32.859652 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.860542 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.860543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:32.860603 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:32.860607 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:32.860658 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 17:50:32.860688 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":2,"thread_start_us":63,"threads_started":1}
I20260808 17:50:32.860805 3992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:32.856373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46950 (local address 127.28.213.129:34157)
0808 17:50:32.856570 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:32.856574 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:32.856583 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:50:32.856616 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:32.856618 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:32.856633 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:32.856714 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:32.857726 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.858795 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.859732 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:32.860390 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:32.860457 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:32.860504 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:32.860680 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 17:50:32.860727 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":95,"threads_started":1}
I20260808 17:50:32.861181 3875 tablet_service.cc:1467] Processing CreateTablet for tablet 0653f17d4dd84093b7f76418db173de2 (DEFAULT_TABLE table=test-table [id=54be7411f16049f597b5e106def53a59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:32.861315 3660 tablet_service.cc:1467] Processing CreateTablet for tablet 0653f17d4dd84093b7f76418db173de2 (DEFAULT_TABLE table=test-table [id=54be7411f16049f597b5e106def53a59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:32.861497 3875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0653f17d4dd84093b7f76418db173de2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:32.861394 3445 tablet_service.cc:1467] Processing CreateTablet for tablet 0653f17d4dd84093b7f76418db173de2 (DEFAULT_TABLE table=test-table [id=54be7411f16049f597b5e106def53a59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:32.861649 3660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0653f17d4dd84093b7f76418db173de2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:32.861670 3445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0653f17d4dd84093b7f76418db173de2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:32.863897 3995 tablet_bootstrap.cc:492] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2: Bootstrap starting.
I20260808 17:50:32.864481 3995 tablet_bootstrap.cc:654] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:32.864775 3997 tablet_bootstrap.cc:492] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82: Bootstrap starting.
I20260808 17:50:32.865182 3995 log.cc:824] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:32.865365 3996 tablet_bootstrap.cc:492] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6: Bootstrap starting.
I20260808 17:50:32.865496 3997 tablet_bootstrap.cc:654] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:32.865939 3996 tablet_bootstrap.cc:654] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:32.866012 3997 log.cc:824] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:32.866204 3995 tablet_bootstrap.cc:492] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2: No bootstrap required, opened a new log
I20260808 17:50:32.866276 3995 ts_tablet_manager.cc:1397] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:50:32.866504 3996 log.cc:824] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:32.866879 3997 tablet_bootstrap.cc:492] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82: No bootstrap required, opened a new log
I20260808 17:50:32.866986 3997 ts_tablet_manager.cc:1397] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:50:32.867165 3996 tablet_bootstrap.cc:492] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6: No bootstrap required, opened a new log
I20260808 17:50:32.867221 3996 ts_tablet_manager.cc:1397] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:50:32.868093 3995 raft_consensus.cc:348] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3edffe6dffb400580e48adf93e2bc82" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45599 } } peers { permanent_uuid: "de6c61e5ba6d4027ad57424a4d15c0b2" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39331 } } peers { permanent_uuid: "568385111cbc463f8a880e1ef66492b6" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 34157 } }
I20260808 17:50:32.868264 3995 raft_consensus.cc:374] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:32.868300 3995 raft_consensus.cc:729] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de6c61e5ba6d4027ad57424a4d15c0b2, State: Initialized, Role: FOLLOWER
I20260808 17:50:32.868435 3995 consensus_queue.cc:260] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3edffe6dffb400580e48adf93e2bc82" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45599 } } peers { permanent_uuid: "de6c61e5ba6d4027ad57424a4d15c0b2" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39331 } } peers { permanent_uuid: "568385111cbc463f8a880e1ef66492b6" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 34157 } }
I20260808 17:50:32.868703 3995 ts_tablet_manager.cc:1428] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:50:32.868846 3976 heartbeater.cc:503] Master 127.28.213.190:38941 was elected leader, sending a full tablet report...
I20260808 17:50:32.868813 3996 raft_consensus.cc:348] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3edffe6dffb400580e48adf93e2bc82" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45599 } } peers { permanent_uuid: "de6c61e5ba6d4027ad57424a4d15c0b2" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39331 } } peers { permanent_uuid: "568385111cbc463f8a880e1ef66492b6" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 34157 } }
I20260808 17:50:32.868974 3996 raft_consensus.cc:374] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:32.869009 3996 raft_consensus.cc:729] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 568385111cbc463f8a880e1ef66492b6, State: Initialized, Role: FOLLOWER
I20260808 17:50:32.868950 3997 raft_consensus.cc:348] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3edffe6dffb400580e48adf93e2bc82" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45599 } } peers { permanent_uuid: "de6c61e5ba6d4027ad57424a4d15c0b2" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39331 } } peers { permanent_uuid: "568385111cbc463f8a880e1ef66492b6" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 34157 } }
I20260808 17:50:32.869058 3997 raft_consensus.cc:374] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:32.869077 3997 raft_consensus.cc:729] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3edffe6dffb400580e48adf93e2bc82, State: Initialized, Role: FOLLOWER
I20260808 17:50:32.869175 3997 consensus_queue.cc:260] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3edffe6dffb400580e48adf93e2bc82" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45599 } } peers { permanent_uuid: "de6c61e5ba6d4027ad57424a4d15c0b2" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39331 } } peers { permanent_uuid: "568385111cbc463f8a880e1ef66492b6" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 34157 } }
I20260808 17:50:32.869483 3997 ts_tablet_manager.cc:1428] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:50:32.869500 3763 heartbeater.cc:503] Master 127.28.213.190:38941 was elected leader, sending a full tablet report...
I20260808 17:50:32.869516 3996 consensus_queue.cc:260] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3edffe6dffb400580e48adf93e2bc82" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45599 } } peers { permanent_uuid: "de6c61e5ba6d4027ad57424a4d15c0b2" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39331 } } peers { permanent_uuid: "568385111cbc463f8a880e1ef66492b6" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 34157 } }
I20260808 17:50:32.869819 3996 ts_tablet_manager.cc:1428] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 17:50:32.869907 3550 heartbeater.cc:503] Master 127.28.213.190:38941 was elected leader, sending a full tablet report...
W20260808 17:50:32.942902 3764 tablet.cc:2369] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:50:33.030288 3551 tablet.cc:2369] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:50:33.084254 3977 tablet.cc:2369] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:50:33.156060 4005 raft_consensus.cc:482] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:50:33.156205 4005 raft_consensus.cc:504] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3edffe6dffb400580e48adf93e2bc82" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45599 } } peers { permanent_uuid: "de6c61e5ba6d4027ad57424a4d15c0b2" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39331 } } peers { permanent_uuid: "568385111cbc463f8a880e1ef66492b6" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 34157 } }
I20260808 17:50:33.156548 4005 leader_election.cc:288] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3edffe6dffb400580e48adf93e2bc82 (127.28.213.130:45599), de6c61e5ba6d4027ad57424a4d15c0b2 (127.28.213.131:39331)
I20260808 17:50:33.159380 3988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.156780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:40445 (local address 127.28.213.130:45599)
0808 17:50:33.156831 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:33.156833 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:33.156873 (+ 40us) server_negotiation.cc:407] Connection header received
0808 17:50:33.157007 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:33.157008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:33.157016 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:33.157061 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:33.157185 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:33.157689 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:33.158679 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:33.159086 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:33.159150 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:33.159160 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:33.159262 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 17:50:33.159294 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 17:50:33.159379 4008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.156711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:45599 (local address 127.28.213.129:40445)
0808 17:50:33.156810 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:33.156821 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:33.156887 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:33.157075 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:33.157076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:33.157078 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:33.157131 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:33.157132 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:33.157759 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:33.157760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:33.158603 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:33.158606 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:33.159152 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:33.159153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:33.159205 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:33.159209 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:33.159252 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 17:50:33.159289 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82,"mutex_wait_us":25,"thread_start_us":46,"threads_started":1}
I20260808 17:50:33.159473 4009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.156859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:39331 (local address 127.28.213.129:36495)
0808 17:50:33.156974 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:33.156984 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:33.157054 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:33.157194 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:33.157195 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:33.157197 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:33.157293 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:33.157295 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:33.157884 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:33.157885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:33.158616 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:33.158618 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:33.159211 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:33.159213 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:33.159291 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:33.159294 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:50:33.159338 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 17:50:33.159374 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":39,"threads_started":1}
I20260808 17:50:33.159459 3990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.156939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:36495 (local address 127.28.213.131:39331)
0808 17:50:33.156990 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:33.156992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:33.157050 (+ 58us) server_negotiation.cc:407] Connection header received
0808 17:50:33.157110 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:33.157110 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:33.157136 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:33.157183 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:33.157352 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:33.157815 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:33.158695 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:33.159139 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:33.159201 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:33.159209 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:33.159352 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 17:50:33.159383 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:50:33.159866 3901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0653f17d4dd84093b7f76418db173de2" candidate_uuid: "568385111cbc463f8a880e1ef66492b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de6c61e5ba6d4027ad57424a4d15c0b2" is_pre_election: true
I20260808 17:50:33.160029 3901 raft_consensus.cc:2454] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 568385111cbc463f8a880e1ef66492b6 in term 0.
I20260808 17:50:33.160151 3686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0653f17d4dd84093b7f76418db173de2" candidate_uuid: "568385111cbc463f8a880e1ef66492b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3edffe6dffb400580e48adf93e2bc82" is_pre_election: true
I20260808 17:50:33.160279 3686 raft_consensus.cc:2454] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 568385111cbc463f8a880e1ef66492b6 in term 0.
I20260808 17:50:33.160256 3377 leader_election.cc:302] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 568385111cbc463f8a880e1ef66492b6, de6c61e5ba6d4027ad57424a4d15c0b2; no voters:
I20260808 17:50:33.160388 4005 raft_consensus.cc:2781] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:50:33.160444 4005 raft_consensus.cc:482] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:50:33.160468 4005 raft_consensus.cc:3037] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:33.161154 4005 raft_consensus.cc:504] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3edffe6dffb400580e48adf93e2bc82" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45599 } } peers { permanent_uuid: "de6c61e5ba6d4027ad57424a4d15c0b2" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39331 } } peers { permanent_uuid: "568385111cbc463f8a880e1ef66492b6" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 34157 } }
I20260808 17:50:33.161294 4005 leader_election.cc:288] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 [CANDIDATE]: Term 1 election: Requested vote from peers a3edffe6dffb400580e48adf93e2bc82 (127.28.213.130:45599), de6c61e5ba6d4027ad57424a4d15c0b2 (127.28.213.131:39331)
I20260808 17:50:33.161530 3686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0653f17d4dd84093b7f76418db173de2" candidate_uuid: "568385111cbc463f8a880e1ef66492b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3edffe6dffb400580e48adf93e2bc82"
I20260808 17:50:33.161531 3901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0653f17d4dd84093b7f76418db173de2" candidate_uuid: "568385111cbc463f8a880e1ef66492b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de6c61e5ba6d4027ad57424a4d15c0b2"
I20260808 17:50:33.161609 3901 raft_consensus.cc:3037] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:33.161609 3686 raft_consensus.cc:3037] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:33.162474 3901 raft_consensus.cc:2454] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 568385111cbc463f8a880e1ef66492b6 in term 1.
I20260808 17:50:33.162474 3686 raft_consensus.cc:2454] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 568385111cbc463f8a880e1ef66492b6 in term 1.
I20260808 17:50:33.162635 3377 leader_election.cc:302] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 568385111cbc463f8a880e1ef66492b6, a3edffe6dffb400580e48adf93e2bc82; no voters:
I20260808 17:50:33.162720 4005 raft_consensus.cc:2781] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:33.162861 4005 raft_consensus.cc:686] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 [term 1 LEADER]: Becoming Leader. State: Replica: 568385111cbc463f8a880e1ef66492b6, State: Running, Role: LEADER
I20260808 17:50:33.162940 4005 consensus_queue.cc:237] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3edffe6dffb400580e48adf93e2bc82" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45599 } } peers { permanent_uuid: "de6c61e5ba6d4027ad57424a4d15c0b2" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39331 } } peers { permanent_uuid: "568385111cbc463f8a880e1ef66492b6" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 34157 } }
I20260808 17:50:33.163678 3263 catalog_manager.cc:5495] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 568385111cbc463f8a880e1ef66492b6 (127.28.213.129). New cstate: current_term: 1 leader_uuid: "568385111cbc463f8a880e1ef66492b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3edffe6dffb400580e48adf93e2bc82" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de6c61e5ba6d4027ad57424a4d15c0b2" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "568385111cbc463f8a880e1ef66492b6" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 34157 } health_report { overall_health: HEALTHY } } }
I20260808 17:50:33.213253 3992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.211009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46952 (local address 127.28.213.129:34157)
0808 17:50:33.211062 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:33.211064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:33.211071 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:50:33.211122 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:33.211123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:33.211141 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:33.211197 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:33.211335 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:33.211791 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:33.212598 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:33.212778 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:33.212819 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:33.212972 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:33.213070 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:33.213129 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:33.213142 (+ 13us) server_negotiation.cc:299] Negotiation successful
0808 17:50:33.213158 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 17:50:33.215013 3686 raft_consensus.cc:1261] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82 [term 1 FOLLOWER]: Refusing update from remote peer 568385111cbc463f8a880e1ef66492b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:33.215013 3901 raft_consensus.cc:1261] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2 [term 1 FOLLOWER]: Refusing update from remote peer 568385111cbc463f8a880e1ef66492b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:33.215373 4005 consensus_queue.cc:1035] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de6c61e5ba6d4027ad57424a4d15c0b2" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:33.215519 4010 consensus_queue.cc:1035] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3edffe6dffb400580e48adf93e2bc82" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:33.218866 4018 mvcc.cc:205] Tried to move back new op lower bound from 7316322030446006272 to 7316322030235852800. Current Snapshot: MvccSnapshot[applied={T|T < 7316322030446006272 or (T in {7316322030446006272})}]
I20260808 17:50:33.219942 3262 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:33.220027 3262 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:33.220728 3262 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6283c375fe244dbf9d441e3ecb19b78d: Sending DeleteTablet for 3 replicas of tablet 0653f17d4dd84093b7f76418db173de2
I20260808 17:50:33.221048 3660 tablet_service.cc:1514] Processing DeleteTablet for tablet 0653f17d4dd84093b7f76418db173de2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:33 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:46448
I20260808 17:50:33.221069 3875 tablet_service.cc:1514] Processing DeleteTablet for tablet 0653f17d4dd84093b7f76418db173de2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:33 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:52692
I20260808 17:50:33.221120 3445 tablet_service.cc:1514] Processing DeleteTablet for tablet 0653f17d4dd84093b7f76418db173de2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:33 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:46950
I20260808 17:50:33.221357 4033 tablet_replica.cc:330] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82: stopping tablet replica
I20260808 17:50:33.221406 4038 tablet_replica.cc:330] T 0653f17d4dd84093b7f76418db173de2 P 568385111cbc463f8a880e1ef66492b6: stopping tablet replica
I20260808 17:50:33.221478 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 3352
I20260808 17:50:33.221513 4033 raft_consensus.cc:2229] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:33.221611 4033 raft_consensus.cc:2258] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:33.221745 4036 tablet_replica.cc:330] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2: stopping tablet replica
I20260808 17:50:33.221830 4036 raft_consensus.cc:2229] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:33.221906 4036 raft_consensus.cc:2258] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:33.222339 4033 ts_tablet_manager.cc:1905] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:33.224119 4033 ts_tablet_manager.cc:1918] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:50:33.224180 4033 log.cc:1196] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/0653f17d4dd84093b7f76418db173de2
I20260808 17:50:33.224387 4036 ts_tablet_manager.cc:1905] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:33.224409 4033 ts_tablet_manager.cc:1939] T 0653f17d4dd84093b7f76418db173de2 P a3edffe6dffb400580e48adf93e2bc82: Deleting consensus metadata
I20260808 17:50:33.224754 3236 catalog_manager.cc:4841] TS a3edffe6dffb400580e48adf93e2bc82 (127.28.213.130:45599): tablet 0653f17d4dd84093b7f76418db173de2 (table test-table [id=54be7411f16049f597b5e106def53a59]) successfully deleted
I20260808 17:50:33.225543 4036 ts_tablet_manager.cc:1918] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:50:33.225598 4036 log.cc:1196] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/0653f17d4dd84093b7f76418db173de2
I20260808 17:50:33.225798 4036 ts_tablet_manager.cc:1939] T 0653f17d4dd84093b7f76418db173de2 P de6c61e5ba6d4027ad57424a4d15c0b2: Deleting consensus metadata
I20260808 17:50:33.227471 3236 catalog_manager.cc:4841] TS de6c61e5ba6d4027ad57424a4d15c0b2 (127.28.213.131:39331): tablet 0653f17d4dd84093b7f76418db173de2 (table test-table [id=54be7411f16049f597b5e106def53a59]) successfully deleted
W20260808 17:50:33.233048 3236 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.213.129:34157 (error 108)
I20260808 17:50:33.233384 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 3556
I20260808 17:50:33.233546 3991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.233385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:34157 (local address 127.0.0.1:46962)
0808 17:50:33.233449 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:33.233500 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.129:34157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 17:50:33.236140 3236 catalog_manager.cc:4584] TS 568385111cbc463f8a880e1ef66492b6 (127.28.213.129:34157): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0653f17d4dd84093b7f76418db173de2: Network error: Client connection negotiation failed: client connection to 127.28.213.129:34157: connect: Connection refused (error 111)
I20260808 17:50:33.251451 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 3773
I20260808 17:50:33.259519 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 3210
2026-08-08T17:50:33Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2233 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T17:50:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:50:33Z Disabled control of system clock
I20260808 17:50:33.292943 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:33973
--webserver_interface=127.28.213.190
--webserver_port=0
--builtin_ntp_servers=127.28.213.148:33641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:33973
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 17:50:33.371830 4046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:33.372020 4046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:33.372038 4046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:33.373076 4046 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:33.373108 4046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:33.373121 4046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:33.373131 4046 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:33.373147 4046 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:50:33.374424 4046 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:33641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:33973
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:33973
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:33.374606 4046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:33.374830 4046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:33.379273 4056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:33.379331 4059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:33.379375 4046 server_base.cc:1034] running on GCE node
W20260808 17:50:33.379285 4055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:33.379679 4046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:33.379942 4046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:33.381083 4046 hybrid_clock.cc:648] HybridClock initialized: now 1786211433381065 us; error 34 us; skew 500 ppm
I20260808 17:50:33.382202 4046 webserver.cc:460] Webserver started at http://127.28.213.190:37091/ using document root <none> and password file <none>
I20260808 17:50:33.382421 4046 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:33.382467 4046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:33.382587 4046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:33.383610 4046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "8878b317a21a411fbc9e9a469acf5f7d"
format_stamp: "Formatted at 2026-08-08 17:50:33 on dist-test-slave-bndk"
server_key: "c8926e0fd500e9d4d4214f30ceeaf357"
server_key_iv: "b5b74e1dcad227f0abfac8525bc1ef02"
server_key_version: "encryptionkey@0"
I20260808 17:50:33.383936 4046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "8878b317a21a411fbc9e9a469acf5f7d"
format_stamp: "Formatted at 2026-08-08 17:50:33 on dist-test-slave-bndk"
server_key: "c8926e0fd500e9d4d4214f30ceeaf357"
server_key_iv: "b5b74e1dcad227f0abfac8525bc1ef02"
server_key_version: "encryptionkey@0"
I20260808 17:50:33.385135 4046 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:50:33.385845 4070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:33.385998 4046 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:33.386075 4046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "8878b317a21a411fbc9e9a469acf5f7d"
format_stamp: "Formatted at 2026-08-08 17:50:33 on dist-test-slave-bndk"
server_key: "c8926e0fd500e9d4d4214f30ceeaf357"
server_key_iv: "b5b74e1dcad227f0abfac8525bc1ef02"
server_key_version: "encryptionkey@0"
I20260808 17:50:33.386145 4046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:33.389300 4046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:33.389544 4046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:33.389658 4046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:33.393285 4046 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:33973
I20260808 17:50:33.393319 4148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:33973 every 8 connection(s)
I20260808 17:50:33.393625 4046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:50:33.394227 4150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:33.396632 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 4046
I20260808 17:50:33.396718 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:50:33.396872 29526 external_mini_cluster.cc:1428] Setting key e2b84425ff2ac3fefe0b651ae4c0d97d
I20260808 17:50:33.397001 4150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d: Bootstrap starting.
I20260808 17:50:33.397643 4150 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:33.397927 4150 log.cc:824] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:33.398597 4150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d: No bootstrap required, opened a new log
I20260808 17:50:33.399864 4153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.397350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33780 (local address 127.28.213.190:33973)
0808 17:50:33.397547 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:33.397556 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:33.397580 (+ 24us) server_negotiation.cc:407] Connection header received
0808 17:50:33.398009 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:33.398018 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:33.398068 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:33.398193 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:33.399478 (+ 1285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:33.399482 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:33.399482 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:50:33.399486 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:33.399526 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:50:33.399536 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:33.399605 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:33.399658 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 17:50:33.399713 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":75,"threads_started":1}
I20260808 17:50:33.400024 4150 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8878b317a21a411fbc9e9a469acf5f7d" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33973 } }
I20260808 17:50:33.400172 4150 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:33.400218 4150 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8878b317a21a411fbc9e9a469acf5f7d, State: Initialized, Role: FOLLOWER
I20260808 17:50:33.400333 4150 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8878b317a21a411fbc9e9a469acf5f7d" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33973 } }
I20260808 17:50:33.400422 4150 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:50:33.400455 4150 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:50:33.400502 4150 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:33.401048 4150 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8878b317a21a411fbc9e9a469acf5f7d" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33973 } }
I20260808 17:50:33.401145 4150 leader_election.cc:302] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8878b317a21a411fbc9e9a469acf5f7d; no voters:
I20260808 17:50:33.401310 4150 leader_election.cc:288] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:50:33.401347 4156 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:33.401476 4156 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d [term 1 LEADER]: Becoming Leader. State: Replica: 8878b317a21a411fbc9e9a469acf5f7d, State: Running, Role: LEADER
I20260808 17:50:33.401567 4150 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:33.401633 4156 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8878b317a21a411fbc9e9a469acf5f7d" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33973 } }
I20260808 17:50:33.401969 4158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8878b317a21a411fbc9e9a469acf5f7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8878b317a21a411fbc9e9a469acf5f7d" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33973 } } }
I20260808 17:50:33.401973 4160 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8878b317a21a411fbc9e9a469acf5f7d. Latest consensus state: current_term: 1 leader_uuid: "8878b317a21a411fbc9e9a469acf5f7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8878b317a21a411fbc9e9a469acf5f7d" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33973 } } }
I20260808 17:50:33.402099 4158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:33.402103 4160 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d [sys.catalog]: This master's current role is: LEADER
W20260808 17:50:33.403270 4184 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:50:33.403316 4184 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:50:33.403375 4173 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:50:33.403546 4173 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:50:33.404960 4173 catalog_manager.cc:1347] Generated new cluster ID: 39bfb1ab43624090a4c989397e50b3ae
I20260808 17:50:33.405021 4173 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:50:33.410583 4173 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:50:33.410727 4173 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:50:33.418802 4173 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d: Generated new TSK 0
I20260808 17:50:33.418960 4173 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:50:33.421566 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:33973
--builtin_ntp_servers=127.28.213.148:33641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 17:50:33.502599 4188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:33.502795 4188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:33.502826 4188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:33.503963 4188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:33.504002 4188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:33.504036 4188 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:50:33.505375 4188 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:33641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:33973
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:33.505602 4188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:33.505872 4188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:33.510428 4201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:33.510473 4198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:33.510649 4203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:33.511036 4188 server_base.cc:1034] running on GCE node
I20260808 17:50:33.511256 4188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:33.511541 4188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:33.512722 4188 hybrid_clock.cc:648] HybridClock initialized: now 1786211433512700 us; error 35 us; skew 500 ppm
I20260808 17:50:33.514114 4188 webserver.cc:460] Webserver started at http://127.28.213.129:43341/ using document root <none> and password file <none>
I20260808 17:50:33.514353 4188 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:33.514407 4188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:33.514528 4188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:33.515833 4188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "e635df7df5e3435495915088128bee4f"
format_stamp: "Formatted at 2026-08-08 17:50:33 on dist-test-slave-bndk"
server_key: "b8ba8a7cc5fcf98dd3576c3ce70b55be"
server_key_iv: "49b2f32e360ddc015f9a40e306a2b48a"
server_key_version: "encryptionkey@0"
I20260808 17:50:33.516232 4188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "e635df7df5e3435495915088128bee4f"
format_stamp: "Formatted at 2026-08-08 17:50:33 on dist-test-slave-bndk"
server_key: "b8ba8a7cc5fcf98dd3576c3ce70b55be"
server_key_iv: "49b2f32e360ddc015f9a40e306a2b48a"
server_key_version: "encryptionkey@0"
I20260808 17:50:33.517807 4188 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:50:33.518620 4212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:33.518771 4188 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:33.518868 4188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "e635df7df5e3435495915088128bee4f"
format_stamp: "Formatted at 2026-08-08 17:50:33 on dist-test-slave-bndk"
server_key: "b8ba8a7cc5fcf98dd3576c3ce70b55be"
server_key_iv: "49b2f32e360ddc015f9a40e306a2b48a"
server_key_version: "encryptionkey@0"
I20260808 17:50:33.518941 4188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:33.523680 4188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:33.523979 4188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:33.524119 4188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:33.524317 4188 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:33.524647 4188 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:33.524698 4188 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:33.524732 4188 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:33.524756 4188 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:33.531241 4188 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:45965
I20260808 17:50:33.531316 4382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:45965 every 8 connection(s)
I20260808 17:50:33.531555 4188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:50:33.534159 4153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.532171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:49349 (local address 127.28.213.190:33973)
0808 17:50:33.532220 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:33.532223 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:33.532450 (+ 227us) server_negotiation.cc:407] Connection header received
0808 17:50:33.532874 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:33.532875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:33.532881 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:33.532933 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:33.533984 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:33.533985 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:33.533985 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:50:33.533989 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:33.534004 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:50:33.534007 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:33.534047 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:33.534097 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 17:50:33.534108 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:50:33.534328 4387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.532169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33973 (local address 127.28.213.129:49349)
0808 17:50:33.532343 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:33.532375 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:33.532781 (+ 406us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:33.532992 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:33.532995 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:33.533004 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:33.533847 (+ 843us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:50:33.533848 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:33.533872 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:50:33.533911 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:33.534053 (+ 142us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:33.534055 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:33.534057 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:50:33.534102 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 17:50:33.534146 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":87,"threads_started":1}
I20260808 17:50:33.534766 4384 heartbeater.cc:347] Connected to a master server at 127.28.213.190:33973
I20260808 17:50:33.534850 4384 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:33.534994 4384 heartbeater.cc:511] Master 127.28.213.190:33973 requested a full tablet report, sending...
I20260808 17:50:33.535432 4094 ts_manager.cc:194] Registered new tserver with Master: e635df7df5e3435495915088128bee4f (127.28.213.129:45965)
I20260808 17:50:33.536747 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 4188
I20260808 17:50:33.536836 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:50:33.537010 29526 external_mini_cluster.cc:1428] Setting key 9290a056efd6d3a7f97d4616cd217f94
I20260808 17:50:33.537853 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:33973
--builtin_ntp_servers=127.28.213.148:33641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 17:50:33.620893 4390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:33.621088 4390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:33.621117 4390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:33.622319 4390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:33.622366 4390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:33.622399 4390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:50:33.623806 4390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:33641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:33973
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:33.624035 4390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:33.624338 4390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:33.628861 4395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:33.629051 4390 server_base.cc:1034] running on GCE node
W20260808 17:50:33.628875 4398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:33.628865 4396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:33.629351 4390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:33.629568 4390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:33.630700 4390 hybrid_clock.cc:648] HybridClock initialized: now 1786211433630683 us; error 32 us; skew 500 ppm
I20260808 17:50:33.631857 4390 webserver.cc:460] Webserver started at http://127.28.213.130:36079/ using document root <none> and password file <none>
I20260808 17:50:33.632057 4390 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:33.632102 4390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:33.632220 4390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:33.633186 4390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "c71ab9b339c04f3a8ae64b9be959e9c2"
format_stamp: "Formatted at 2026-08-08 17:50:33 on dist-test-slave-bndk"
server_key: "18c4b65e162d2069ba9e0ba709f701e8"
server_key_iv: "efc7bb649d2ae1a4e90ffe43b5ced0b3"
server_key_version: "encryptionkey@0"
I20260808 17:50:33.633556 4390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "c71ab9b339c04f3a8ae64b9be959e9c2"
format_stamp: "Formatted at 2026-08-08 17:50:33 on dist-test-slave-bndk"
server_key: "18c4b65e162d2069ba9e0ba709f701e8"
server_key_iv: "efc7bb649d2ae1a4e90ffe43b5ced0b3"
server_key_version: "encryptionkey@0"
I20260808 17:50:33.634723 4390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:50:33.635370 4407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:33.635506 4390 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:33.635588 4390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "c71ab9b339c04f3a8ae64b9be959e9c2"
format_stamp: "Formatted at 2026-08-08 17:50:33 on dist-test-slave-bndk"
server_key: "18c4b65e162d2069ba9e0ba709f701e8"
server_key_iv: "efc7bb649d2ae1a4e90ffe43b5ced0b3"
server_key_version: "encryptionkey@0"
I20260808 17:50:33.635648 4390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:33.638837 4390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:33.639056 4390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:33.639168 4390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:33.639338 4390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:33.639622 4390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:33.639655 4390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:33.639680 4390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:33.639705 4390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:33.644984 4390 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:37835
I20260808 17:50:33.645040 4596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:37835 every 8 connection(s)
I20260808 17:50:33.645341 4390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:50:33.647927 4153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.645918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:56601 (local address 127.28.213.190:33973)
0808 17:50:33.645961 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:33.645963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:33.646165 (+ 202us) server_negotiation.cc:407] Connection header received
0808 17:50:33.646589 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:33.646591 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:33.646598 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:33.646649 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:33.647684 (+ 1035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:33.647685 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:33.647686 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:50:33.647690 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:33.647705 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:50:33.647709 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:33.647756 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:33.647834 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 17:50:33.647848 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:50:33.648087 4601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.645905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33973 (local address 127.28.213.130:56601)
0808 17:50:33.646062 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:33.646091 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:33.646500 (+ 409us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:33.646710 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:33.646714 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:33.646723 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:33.647550 (+ 827us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:50:33.647550 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:33.647576 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:50:33.647602 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:33.647764 (+ 162us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:33.647769 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:33.647771 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:50:33.647840 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 17:50:33.647898 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":76,"threads_started":1}
I20260808 17:50:33.648497 4597 heartbeater.cc:347] Connected to a master server at 127.28.213.190:33973
I20260808 17:50:33.648574 4597 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:33.648679 4597 heartbeater.cc:511] Master 127.28.213.190:33973 requested a full tablet report, sending...
I20260808 17:50:33.648976 4094 ts_manager.cc:194] Registered new tserver with Master: c71ab9b339c04f3a8ae64b9be959e9c2 (127.28.213.130:37835)
I20260808 17:50:33.652707 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 4390
I20260808 17:50:33.652786 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:50:33.652944 29526 external_mini_cluster.cc:1428] Setting key 32ee9c743c070a4390b4218d23dd2bc2
I20260808 17:50:33.653753 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:33973
--builtin_ntp_servers=127.28.213.148:33641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 17:50:33.735245 4602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:33.735441 4602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:33.735463 4602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:33.736572 4602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:33.736609 4602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:33.736634 4602 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:50:33.737986 4602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:33641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:33973
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:33.738179 4602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:33.738459 4602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:33.743018 4611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:33.743026 4614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:33.743126 4602 server_base.cc:1034] running on GCE node
W20260808 17:50:33.743211 4612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:33.743409 4602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:33.743625 4602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:33.744760 4602 hybrid_clock.cc:648] HybridClock initialized: now 1786211433744749 us; error 28 us; skew 500 ppm
I20260808 17:50:33.745901 4602 webserver.cc:460] Webserver started at http://127.28.213.131:45635/ using document root <none> and password file <none>
I20260808 17:50:33.746133 4602 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:33.746193 4602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:33.746326 4602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:33.747423 4602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "88698a6902c749e8a62e82a5e882519e"
format_stamp: "Formatted at 2026-08-08 17:50:33 on dist-test-slave-bndk"
server_key: "393d3183633c5fcf1fb16b8d936cc76e"
server_key_iv: "dcf04d347261449344e587aa527833f0"
server_key_version: "encryptionkey@0"
I20260808 17:50:33.747742 4602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "88698a6902c749e8a62e82a5e882519e"
format_stamp: "Formatted at 2026-08-08 17:50:33 on dist-test-slave-bndk"
server_key: "393d3183633c5fcf1fb16b8d936cc76e"
server_key_iv: "dcf04d347261449344e587aa527833f0"
server_key_version: "encryptionkey@0"
I20260808 17:50:33.748997 4602 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:50:33.749722 4621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:33.749858 4602 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:33.749938 4602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "88698a6902c749e8a62e82a5e882519e"
format_stamp: "Formatted at 2026-08-08 17:50:33 on dist-test-slave-bndk"
server_key: "393d3183633c5fcf1fb16b8d936cc76e"
server_key_iv: "dcf04d347261449344e587aa527833f0"
server_key_version: "encryptionkey@0"
I20260808 17:50:33.750005 4602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:33.753126 4602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:33.753366 4602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:33.753485 4602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:33.753669 4602 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:33.753934 4602 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:33.753966 4602 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:33.753984 4602 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:33.754007 4602 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:33.759333 4602 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:39249
I20260808 17:50:33.759368 4782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:39249 every 8 connection(s)
I20260808 17:50:33.759632 4602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:50:33.762079 4153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.760223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:35527 (local address 127.28.213.190:33973)
0808 17:50:33.760276 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:33.760278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:33.760465 (+ 187us) server_negotiation.cc:407] Connection header received
0808 17:50:33.760846 (+ 381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:33.760847 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:33.760853 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:33.760905 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:33.761903 (+ 998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:33.761904 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:33.761905 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:50:33.761908 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:33.761922 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:50:33.761926 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:33.761967 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:33.762018 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 17:50:33.762030 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:50:33.762218 4787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.760196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33973 (local address 127.28.213.131:35527)
0808 17:50:33.760359 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:33.760401 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:33.760771 (+ 370us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:33.760953 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:33.760956 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:33.760963 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:33.761773 (+ 810us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:50:33.761774 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:33.761799 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:50:33.761825 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:33.761967 (+ 142us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:33.761970 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:33.761972 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:50:33.762015 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 17:50:33.762058 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":64,"threads_started":1}
I20260808 17:50:33.762632 4784 heartbeater.cc:347] Connected to a master server at 127.28.213.190:33973
I20260808 17:50:33.762714 4784 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:33.762853 4784 heartbeater.cc:511] Master 127.28.213.190:33973 requested a full tablet report, sending...
I20260808 17:50:33.763191 4094 ts_manager.cc:194] Registered new tserver with Master: 88698a6902c749e8a62e82a5e882519e (127.28.213.131:39249)
I20260808 17:50:33.768394 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 4602
I20260808 17:50:33.768474 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:50:33.768611 29526 external_mini_cluster.cc:1428] Setting key 13171ba9491675e5359b41a7b946ed44
I20260808 17:50:33.769305 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:50:33.771222 4153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.770475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33784 (local address 127.28.213.190:33973)
0808 17:50:33.770515 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:33.770516 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:33.770588 (+ 72us) server_negotiation.cc:407] Connection header received
0808 17:50:33.770646 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:33.770647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:33.770650 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:33.770683 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:33.771070 (+ 387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:33.771071 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:33.771072 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:50:33.771075 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:33.771086 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:50:33.771089 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:33.771126 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:33.771154 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 17:50:33.771164 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:50:33.772495 4094 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33784:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:50:33.774027 4094 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:50:33.777314 4796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.775779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:37835 (local address 127.0.0.1:46310)
0808 17:50:33.775886 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:33.775926 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:33.775982 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:33.776389 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:33.776396 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:33.776402 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:33.776931 (+ 529us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:50:33.776932 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:33.776945 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:50:33.776965 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:33.777154 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:33.777159 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:33.777162 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:50:33.777239 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 17:50:33.777252 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80,"thread_start_us":58,"threads_started":1}
I20260808 17:50:33.777338 4802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.776045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46310 (local address 127.28.213.130:37835)
0808 17:50:33.776260 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:33.776263 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:33.776273 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:50:33.776298 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:33.776300 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:33.776310 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:33.776391 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:33.777027 (+ 636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:33.777035 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:33.777035 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:50:33.777039 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:33.777073 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:50:33.777100 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:33.777162 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:33.777246 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 17:50:33.777261 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":93,"threads_started":1}
I20260808 17:50:33.777595 4799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.775870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37242 (local address 127.28.213.131:39249)
0808 17:50:33.776125 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:33.776130 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:33.776300 (+ 170us) server_negotiation.cc:407] Connection header received
0808 17:50:33.776362 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:33.776366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:33.776373 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:33.776445 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:33.777275 (+ 830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:33.777282 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:33.777282 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:50:33.777287 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:33.777318 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:50:33.777337 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:33.777404 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:33.777509 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 17:50:33.777524 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":91,"threads_started":1}
I20260808 17:50:33.777770 4797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.775779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:39249 (local address 127.0.0.1:37242)
0808 17:50:33.776235 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:33.776246 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:33.776302 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:33.776692 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:33.776693 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:33.776696 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:33.777050 (+ 354us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:50:33.777051 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:33.777055 (+ 4us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:50:33.777064 (+ 9us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:33.777431 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:33.777432 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:33.777433 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 17:50:33.777702 (+ 269us) client_negotiation.cc:240] Negotiation successful
0808 17:50:33.777715 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"mutex_wait_us":3,"thread_start_us":82,"threads_started":1}
I20260808 17:50:33.777998 4805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.776092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38286 (local address 127.28.213.129:45965)
0808 17:50:33.776246 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:33.776250 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:33.776358 (+ 108us) server_negotiation.cc:407] Connection header received
0808 17:50:33.776395 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:33.776398 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:33.776407 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:33.776476 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:33.777600 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:33.777607 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:33.777607 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:50:33.777610 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:33.777642 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:50:33.777670 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:33.777722 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:33.777905 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 17:50:33.777921 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":82,"threads_started":1}
I20260808 17:50:33.777841 4800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.775973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:45965 (local address 127.0.0.1:38286)
0808 17:50:33.776259 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:33.776268 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:33.776307 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:33.776782 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:33.776782 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:33.776785 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:33.777509 (+ 724us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:50:33.777509 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:33.777515 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:50:33.777525 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:33.777744 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:33.777745 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:33.777746 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 17:50:33.777785 (+ 39us) client_negotiation.cc:240] Negotiation successful
0808 17:50:33.777795 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":69,"threads_started":1}
I20260808 17:50:33.777967 4490 tablet_service.cc:1467] Processing CreateTablet for tablet 9c624f60b7db440a9782deb4852ea4b4 (DEFAULT_TABLE table=test-table [id=29a05ac8d9fe49508867b57a2fb71b69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:33.778316 4490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c624f60b7db440a9782deb4852ea4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:33.780611 4807 tablet_bootstrap.cc:492] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2: Bootstrap starting.
I20260808 17:50:33.780911 4685 tablet_service.cc:1467] Processing CreateTablet for tablet 9c624f60b7db440a9782deb4852ea4b4 (DEFAULT_TABLE table=test-table [id=29a05ac8d9fe49508867b57a2fb71b69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:33.781208 4685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c624f60b7db440a9782deb4852ea4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:33.781355 4807 tablet_bootstrap.cc:654] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:33.781661 4807 log.cc:824] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:33.781658 4282 tablet_service.cc:1467] Processing CreateTablet for tablet 9c624f60b7db440a9782deb4852ea4b4 (DEFAULT_TABLE table=test-table [id=29a05ac8d9fe49508867b57a2fb71b69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:33.781965 4282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c624f60b7db440a9782deb4852ea4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:33.783588 4809 tablet_bootstrap.cc:492] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e: Bootstrap starting.
I20260808 17:50:33.784240 4809 tablet_bootstrap.cc:654] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:33.784282 4807 tablet_bootstrap.cc:492] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2: No bootstrap required, opened a new log
I20260808 17:50:33.784402 4807 ts_tablet_manager.cc:1397] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260808 17:50:33.784401 4810 tablet_bootstrap.cc:492] T 9c624f60b7db440a9782deb4852ea4b4 P e635df7df5e3435495915088128bee4f: Bootstrap starting.
I20260808 17:50:33.784771 4809 log.cc:824] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:33.785006 4810 tablet_bootstrap.cc:654] T 9c624f60b7db440a9782deb4852ea4b4 P e635df7df5e3435495915088128bee4f: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:33.785321 4810 log.cc:824] T 9c624f60b7db440a9782deb4852ea4b4 P e635df7df5e3435495915088128bee4f: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:33.785589 4809 tablet_bootstrap.cc:492] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e: No bootstrap required, opened a new log
I20260808 17:50:33.785653 4809 ts_tablet_manager.cc:1397] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:50:33.786106 4810 tablet_bootstrap.cc:492] T 9c624f60b7db440a9782deb4852ea4b4 P e635df7df5e3435495915088128bee4f: No bootstrap required, opened a new log
I20260808 17:50:33.786173 4810 ts_tablet_manager.cc:1397] T 9c624f60b7db440a9782deb4852ea4b4 P e635df7df5e3435495915088128bee4f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:50:33.786556 4807 raft_consensus.cc:348] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c71ab9b339c04f3a8ae64b9be959e9c2" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37835 } } peers { permanent_uuid: "e635df7df5e3435495915088128bee4f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45965 } } peers { permanent_uuid: "88698a6902c749e8a62e82a5e882519e" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39249 } }
I20260808 17:50:33.786680 4807 raft_consensus.cc:374] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:33.786713 4807 raft_consensus.cc:729] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c71ab9b339c04f3a8ae64b9be959e9c2, State: Initialized, Role: FOLLOWER
I20260808 17:50:33.786841 4807 consensus_queue.cc:260] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c71ab9b339c04f3a8ae64b9be959e9c2" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37835 } } peers { permanent_uuid: "e635df7df5e3435495915088128bee4f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45965 } } peers { permanent_uuid: "88698a6902c749e8a62e82a5e882519e" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39249 } }
I20260808 17:50:33.787259 4807 ts_tablet_manager.cc:1428] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 17:50:33.787366 4597 heartbeater.cc:503] Master 127.28.213.190:33973 was elected leader, sending a full tablet report...
I20260808 17:50:33.787976 4809 raft_consensus.cc:348] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c71ab9b339c04f3a8ae64b9be959e9c2" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37835 } } peers { permanent_uuid: "e635df7df5e3435495915088128bee4f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45965 } } peers { permanent_uuid: "88698a6902c749e8a62e82a5e882519e" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39249 } }
I20260808 17:50:33.788178 4809 raft_consensus.cc:374] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:33.788246 4809 raft_consensus.cc:729] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88698a6902c749e8a62e82a5e882519e, State: Initialized, Role: FOLLOWER
I20260808 17:50:33.788378 4809 consensus_queue.cc:260] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c71ab9b339c04f3a8ae64b9be959e9c2" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37835 } } peers { permanent_uuid: "e635df7df5e3435495915088128bee4f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45965 } } peers { permanent_uuid: "88698a6902c749e8a62e82a5e882519e" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39249 } }
I20260808 17:50:33.788627 4809 ts_tablet_manager.cc:1428] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:50:33.788582 4810 raft_consensus.cc:348] T 9c624f60b7db440a9782deb4852ea4b4 P e635df7df5e3435495915088128bee4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c71ab9b339c04f3a8ae64b9be959e9c2" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37835 } } peers { permanent_uuid: "e635df7df5e3435495915088128bee4f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45965 } } peers { permanent_uuid: "88698a6902c749e8a62e82a5e882519e" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39249 } }
I20260808 17:50:33.788755 4810 raft_consensus.cc:374] T 9c624f60b7db440a9782deb4852ea4b4 P e635df7df5e3435495915088128bee4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:33.788806 4810 raft_consensus.cc:729] T 9c624f60b7db440a9782deb4852ea4b4 P e635df7df5e3435495915088128bee4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e635df7df5e3435495915088128bee4f, State: Initialized, Role: FOLLOWER
I20260808 17:50:33.788915 4810 consensus_queue.cc:260] T 9c624f60b7db440a9782deb4852ea4b4 P e635df7df5e3435495915088128bee4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c71ab9b339c04f3a8ae64b9be959e9c2" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37835 } } peers { permanent_uuid: "e635df7df5e3435495915088128bee4f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45965 } } peers { permanent_uuid: "88698a6902c749e8a62e82a5e882519e" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39249 } }
I20260808 17:50:33.789173 4810 ts_tablet_manager.cc:1428] T 9c624f60b7db440a9782deb4852ea4b4 P e635df7df5e3435495915088128bee4f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:50:33.789253 4384 heartbeater.cc:503] Master 127.28.213.190:33973 was elected leader, sending a full tablet report...
I20260808 17:50:33.789671 4784 heartbeater.cc:503] Master 127.28.213.190:33973 was elected leader, sending a full tablet report...
W20260808 17:50:33.895844 4599 tablet.cc:2369] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:50:33.955457 4814 raft_consensus.cc:482] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:50:33.955574 4814 raft_consensus.cc:504] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c71ab9b339c04f3a8ae64b9be959e9c2" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37835 } } peers { permanent_uuid: "e635df7df5e3435495915088128bee4f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45965 } } peers { permanent_uuid: "88698a6902c749e8a62e82a5e882519e" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39249 } }
I20260808 17:50:33.955899 4814 leader_election.cc:288] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e635df7df5e3435495915088128bee4f (127.28.213.129:45965), 88698a6902c749e8a62e82a5e882519e (127.28.213.131:39249)
I20260808 17:50:33.957181 4799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.956171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:37051 (local address 127.28.213.131:39249)
0808 17:50:33.956212 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:33.956214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:33.956222 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:33.956250 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:33.956251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:33.956256 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:33.956309 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:33.956953 (+ 644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:33.956955 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:33.956955 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:50:33.956961 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:33.956980 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:50:33.956986 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:33.957050 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:33.957095 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 17:50:33.957109 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:50:33.957180 4601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.956060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:39249 (local address 127.28.213.130:37051)
0808 17:50:33.956115 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:33.956125 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:33.956167 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:33.956331 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:33.956332 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:33.956335 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:33.956816 (+ 481us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:50:33.956816 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:33.956823 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:50:33.956842 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:33.957053 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:33.957053 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:33.957054 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 17:50:33.957092 (+ 38us) client_negotiation.cc:240] Negotiation successful
0808 17:50:33.957107 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 17:50:33.957239 4805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.956175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:41069 (local address 127.28.213.129:45965)
0808 17:50:33.956229 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:33.956231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:33.956346 (+ 115us) server_negotiation.cc:407] Connection header received
0808 17:50:33.956374 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:33.956375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:33.956381 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:33.956417 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:33.957027 (+ 610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:33.957028 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:33.957028 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:50:33.957032 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:33.957047 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:50:33.957052 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:33.957104 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:33.957152 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 17:50:33.957164 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 17:50:33.957434 4819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:33.956061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:45965 (local address 127.28.213.130:41069)
0808 17:50:33.956259 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:33.956267 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:33.956311 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:33.956433 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:33.956434 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:33.956436 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:33.956938 (+ 502us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:50:33.956938 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:33.956945 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:50:33.956954 (+ 9us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:33.957105 (+ 151us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:33.957106 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:33.957106 (+ 0us) client_negotiation.cc:769] Sending connection context
0808 17:50:33.957144 (+ 38us) client_negotiation.cc:240] Negotiation successful
0808 17:50:33.957154 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":51,"thread_start_us":87,"threads_started":1}
I20260808 17:50:33.957600 4717 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c624f60b7db440a9782deb4852ea4b4" candidate_uuid: "c71ab9b339c04f3a8ae64b9be959e9c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88698a6902c749e8a62e82a5e882519e" is_pre_election: true
I20260808 17:50:33.957757 4717 raft_consensus.cc:2454] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c71ab9b339c04f3a8ae64b9be959e9c2 in term 0.
I20260808 17:50:33.957808 4311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c624f60b7db440a9782deb4852ea4b4" candidate_uuid: "c71ab9b339c04f3a8ae64b9be959e9c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e635df7df5e3435495915088128bee4f" is_pre_election: true
I20260808 17:50:33.957962 4311 raft_consensus.cc:2454] T 9c624f60b7db440a9782deb4852ea4b4 P e635df7df5e3435495915088128bee4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c71ab9b339c04f3a8ae64b9be959e9c2 in term 0.
I20260808 17:50:33.957969 4413 leader_election.cc:302] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88698a6902c749e8a62e82a5e882519e, c71ab9b339c04f3a8ae64b9be959e9c2; no voters:
I20260808 17:50:33.958092 4814 raft_consensus.cc:2781] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:50:33.958174 4814 raft_consensus.cc:482] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:50:33.958195 4814 raft_consensus.cc:3037] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:33.958891 4814 raft_consensus.cc:504] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c71ab9b339c04f3a8ae64b9be959e9c2" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37835 } } peers { permanent_uuid: "e635df7df5e3435495915088128bee4f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45965 } } peers { permanent_uuid: "88698a6902c749e8a62e82a5e882519e" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39249 } }
I20260808 17:50:33.959002 4814 leader_election.cc:288] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [CANDIDATE]: Term 1 election: Requested vote from peers e635df7df5e3435495915088128bee4f (127.28.213.129:45965), 88698a6902c749e8a62e82a5e882519e (127.28.213.131:39249)
I20260808 17:50:33.959137 4311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c624f60b7db440a9782deb4852ea4b4" candidate_uuid: "c71ab9b339c04f3a8ae64b9be959e9c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e635df7df5e3435495915088128bee4f"
I20260808 17:50:33.959153 4717 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c624f60b7db440a9782deb4852ea4b4" candidate_uuid: "c71ab9b339c04f3a8ae64b9be959e9c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88698a6902c749e8a62e82a5e882519e"
I20260808 17:50:33.959203 4311 raft_consensus.cc:3037] T 9c624f60b7db440a9782deb4852ea4b4 P e635df7df5e3435495915088128bee4f [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:33.959227 4717 raft_consensus.cc:3037] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:33.959887 4311 raft_consensus.cc:2454] T 9c624f60b7db440a9782deb4852ea4b4 P e635df7df5e3435495915088128bee4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c71ab9b339c04f3a8ae64b9be959e9c2 in term 1.
I20260808 17:50:33.959951 4717 raft_consensus.cc:2454] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c71ab9b339c04f3a8ae64b9be959e9c2 in term 1.
I20260808 17:50:33.960089 4410 leader_election.cc:302] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c71ab9b339c04f3a8ae64b9be959e9c2, e635df7df5e3435495915088128bee4f; no voters:
I20260808 17:50:33.960186 4814 raft_consensus.cc:2781] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:33.960307 4814 raft_consensus.cc:686] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [term 1 LEADER]: Becoming Leader. State: Replica: c71ab9b339c04f3a8ae64b9be959e9c2, State: Running, Role: LEADER
I20260808 17:50:33.960382 4814 consensus_queue.cc:237] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c71ab9b339c04f3a8ae64b9be959e9c2" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37835 } } peers { permanent_uuid: "e635df7df5e3435495915088128bee4f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45965 } } peers { permanent_uuid: "88698a6902c749e8a62e82a5e882519e" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39249 } }
I20260808 17:50:33.961160 4092 catalog_manager.cc:5495] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c71ab9b339c04f3a8ae64b9be959e9c2 (127.28.213.130). New cstate: current_term: 1 leader_uuid: "c71ab9b339c04f3a8ae64b9be959e9c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c71ab9b339c04f3a8ae64b9be959e9c2" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e635df7df5e3435495915088128bee4f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88698a6902c749e8a62e82a5e882519e" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260808 17:50:34.005354 4802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:34.000440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46312 (local address 127.28.213.130:37835)
0808 17:50:34.000492 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:34.000494 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:34.000504 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:50:34.000537 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:34.000538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:34.000549 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:34.000593 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:34.005137 (+ 4544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:34.005138 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:34.005138 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:50:34.005142 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:34.005158 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:50:34.005162 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:34.005205 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:34.005272 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 17:50:34.005285 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 17:50:34.006958 4311 raft_consensus.cc:1261] T 9c624f60b7db440a9782deb4852ea4b4 P e635df7df5e3435495915088128bee4f [term 1 FOLLOWER]: Refusing update from remote peer c71ab9b339c04f3a8ae64b9be959e9c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:34.006968 4717 raft_consensus.cc:1261] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e [term 1 FOLLOWER]: Refusing update from remote peer c71ab9b339c04f3a8ae64b9be959e9c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:34.007296 4814 consensus_queue.cc:1035] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e635df7df5e3435495915088128bee4f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:34.007427 4823 consensus_queue.cc:1035] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88698a6902c749e8a62e82a5e882519e" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:34.009811 4831 mvcc.cc:205] Tried to move back new op lower bound from 7316322033690210304 to 7316322033502216192. Current Snapshot: MvccSnapshot[applied={T|T < 7316322033690210304}]
I20260808 17:50:34.011883 4092 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:34.011963 4092 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:34.012602 4092 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8878b317a21a411fbc9e9a469acf5f7d: Sending DeleteTablet for 3 replicas of tablet 9c624f60b7db440a9782deb4852ea4b4
I20260808 17:50:34.012900 4490 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c624f60b7db440a9782deb4852ea4b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:34 UTC) from {username='slave'} at 127.0.0.1:46310
I20260808 17:50:34.012933 4282 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c624f60b7db440a9782deb4852ea4b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:34 UTC) from {username='slave'} at 127.0.0.1:38286
I20260808 17:50:34.013123 4685 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c624f60b7db440a9782deb4852ea4b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:34 UTC) from {username='slave'} at 127.0.0.1:37242
I20260808 17:50:34.013340 4843 tablet_replica.cc:330] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e: stopping tablet replica
I20260808 17:50:34.013432 4842 tablet_replica.cc:330] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2: stopping tablet replica
I20260808 17:50:34.013460 4843 raft_consensus.cc:2229] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:34.013576 4842 raft_consensus.cc:2229] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:50:34.013582 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 4188
I20260808 17:50:34.013693 4842 raft_consensus.cc:2258] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:34.013612 4843 raft_consensus.cc:2258] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:34.018034 4843 ts_tablet_manager.cc:1905] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:34.019829 4843 ts_tablet_manager.cc:1918] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:50:34.019968 4843 log.cc:1196] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/9c624f60b7db440a9782deb4852ea4b4
I20260808 17:50:34.020303 4843 ts_tablet_manager.cc:1939] T 9c624f60b7db440a9782deb4852ea4b4 P 88698a6902c749e8a62e82a5e882519e: Deleting consensus metadata
I20260808 17:50:34.020769 4073 catalog_manager.cc:4841] TS 88698a6902c749e8a62e82a5e882519e (127.28.213.131:39249): tablet 9c624f60b7db440a9782deb4852ea4b4 (table test-table [id=29a05ac8d9fe49508867b57a2fb71b69]) successfully deleted
I20260808 17:50:34.026517 4842 ts_tablet_manager.cc:1905] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:34.028020 4842 ts_tablet_manager.cc:1918] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:50:34.028098 4842 log.cc:1196] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/9c624f60b7db440a9782deb4852ea4b4
I20260808 17:50:34.028395 4842 ts_tablet_manager.cc:1939] T 9c624f60b7db440a9782deb4852ea4b4 P c71ab9b339c04f3a8ae64b9be959e9c2: Deleting consensus metadata
I20260808 17:50:34.028788 4071 catalog_manager.cc:4841] TS c71ab9b339c04f3a8ae64b9be959e9c2 (127.28.213.130:37835): tablet 9c624f60b7db440a9782deb4852ea4b4 (table test-table [id=29a05ac8d9fe49508867b57a2fb71b69]) successfully deleted
W20260808 17:50:34.030393 4071 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.213.129:45965 (error 108)
I20260808 17:50:34.030862 4800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:34.030732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:45965 (local address 127.0.0.1:38294)
0808 17:50:34.030784 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:34.030827 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.129:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 17:50:34.030905 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 4390
W20260808 17:50:34.039860 4071 catalog_manager.cc:4584] TS e635df7df5e3435495915088128bee4f (127.28.213.129:45965): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9c624f60b7db440a9782deb4852ea4b4: Network error: Client connection negotiation failed: client connection to 127.28.213.129:45965: connect: Connection refused (error 111)
I20260808 17:50:34.044951 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 4602
I20260808 17:50:34.051859 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 4046
2026-08-08T17:50:34Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (787 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 17:50:34.072944 29526 mini_oidc.cc:152] Starting JWKS server
I20260808 17:50:34.074295 29526 webserver.cc:460] Webserver started at https://127.0.0.1:33175/ using document root <none> and password file <none>
I20260808 17:50:34.074375 29526 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 17:50:34.074513 29526 webserver.cc:460] Webserver started at http://127.0.0.1:33043/ using document root <none> and password file <none>
2026-08-08T17:50:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:50:34Z Disabled control of system clock
I20260808 17:50:34.082231 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:37099
--webserver_interface=127.28.213.190
--webserver_port=0
--builtin_ntp_servers=127.28.213.148:44361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:37099
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33175/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0/testchainca.cert with env {}
W20260808 17:50:34.176419 4851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:34.176607 4851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:34.176628 4851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:34.177773 4851 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:34.177812 4851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:34.177824 4851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:34.177835 4851 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:34.177852 4851 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 17:50:34.177863 4851 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 17:50:34.177873 4851 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33175/jwks.json
I20260808 17:50:34.179363 4851 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:44361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:37099
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:37099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33175/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4851
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:34.179550 4851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:34.179714 4851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:34.184336 4859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:34.184365 4860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:34.184399 4851 server_base.cc:1034] running on GCE node
W20260808 17:50:34.184439 4863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:34.184782 4851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:34.185055 4851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:34.186187 4851 hybrid_clock.cc:648] HybridClock initialized: now 1786211434186163 us; error 39 us; skew 500 ppm
I20260808 17:50:34.187331 4851 webserver.cc:460] Webserver started at http://127.28.213.190:40263/ using document root <none> and password file <none>
I20260808 17:50:34.187544 4851 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:34.187593 4851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:34.187716 4851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:34.188709 4851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "926690dca1564b2a841ef6a3d8ff55cc"
format_stamp: "Formatted at 2026-08-08 17:50:34 on dist-test-slave-bndk"
server_key: "4e169d0d074580cfa5e5794db3253d38"
server_key_iv: "e259e0aa2f5a7b7fa55fc8436adfa583"
server_key_version: "encryptionkey@0"
I20260808 17:50:34.189116 4851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "926690dca1564b2a841ef6a3d8ff55cc"
format_stamp: "Formatted at 2026-08-08 17:50:34 on dist-test-slave-bndk"
server_key: "4e169d0d074580cfa5e5794db3253d38"
server_key_iv: "e259e0aa2f5a7b7fa55fc8436adfa583"
server_key_version: "encryptionkey@0"
I20260808 17:50:34.190327 4851 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:50:34.191041 4873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:34.191206 4851 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:34.191303 4851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "926690dca1564b2a841ef6a3d8ff55cc"
format_stamp: "Formatted at 2026-08-08 17:50:34 on dist-test-slave-bndk"
server_key: "4e169d0d074580cfa5e5794db3253d38"
server_key_iv: "e259e0aa2f5a7b7fa55fc8436adfa583"
server_key_version: "encryptionkey@0"
I20260808 17:50:34.191363 4851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:34.207062 4851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:34.207329 4851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:34.207458 4851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:34.211205 4851 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:37099
I20260808 17:50:34.211243 4957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:37099 every 8 connection(s)
I20260808 17:50:34.211553 4851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:50:34.212569 4958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:34.214864 4958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc: Bootstrap starting.
I20260808 17:50:34.215488 4958 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:34.215762 4958 log.cc:824] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:34.216163 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 4851
I20260808 17:50:34.216269 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:50:34.216460 29526 external_mini_cluster.cc:1428] Setting key 643cb7272d6faae58fcf5367990f1712
I20260808 17:50:34.216513 4958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc: No bootstrap required, opened a new log
I20260808 17:50:34.219244 4958 raft_consensus.cc:348] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "926690dca1564b2a841ef6a3d8ff55cc" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 37099 } }
I20260808 17:50:34.219414 4958 raft_consensus.cc:374] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:34.219444 4958 raft_consensus.cc:729] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926690dca1564b2a841ef6a3d8ff55cc, State: Initialized, Role: FOLLOWER
I20260808 17:50:34.219563 4958 consensus_queue.cc:260] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "926690dca1564b2a841ef6a3d8ff55cc" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 37099 } }
I20260808 17:50:34.219643 4958 raft_consensus.cc:388] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:50:34.219686 4958 raft_consensus.cc:482] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:50:34.219726 4958 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:34.220232 4958 raft_consensus.cc:504] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "926690dca1564b2a841ef6a3d8ff55cc" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 37099 } }
I20260808 17:50:34.220328 4958 leader_election.cc:302] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 926690dca1564b2a841ef6a3d8ff55cc; no voters:
I20260808 17:50:34.220481 4958 leader_election.cc:288] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:50:34.220517 4964 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:34.220688 4964 raft_consensus.cc:686] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc [term 1 LEADER]: Becoming Leader. State: Replica: 926690dca1564b2a841ef6a3d8ff55cc, State: Running, Role: LEADER
I20260808 17:50:34.220722 4958 sys_catalog.cc:564] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:34.220830 4964 consensus_queue.cc:237] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "926690dca1564b2a841ef6a3d8ff55cc" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 37099 } }
I20260808 17:50:34.221189 4966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "926690dca1564b2a841ef6a3d8ff55cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "926690dca1564b2a841ef6a3d8ff55cc" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 37099 } } }
I20260808 17:50:34.221324 4966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:34.221596 4982 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:50:34.222105 4982 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:50:34.222132 4965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 926690dca1564b2a841ef6a3d8ff55cc. Latest consensus state: current_term: 1 leader_uuid: "926690dca1564b2a841ef6a3d8ff55cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "926690dca1564b2a841ef6a3d8ff55cc" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 37099 } } }
I20260808 17:50:34.222234 4965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:34.223251 4963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:34.216931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41722 (local address 127.28.213.190:37099)
0808 17:50:34.217138 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:34.217147 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:34.217183 (+ 36us) server_negotiation.cc:407] Connection header received
0808 17:50:34.217843 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:34.217854 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:34.217941 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:34.218089 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:34.218238 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.219551 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.220398 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.221026 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.221154 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:34.222556 (+ 1402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:34.222560 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:34.222560 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:50:34.222763 (+ 203us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:34.222802 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:50:34.222816 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:34.222885 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:34.222978 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 17:50:34.223054 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":76,"threads_started":1}
I20260808 17:50:34.224069 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:50:34.224104 4982 catalog_manager.cc:1347] Generated new cluster ID: 9a14773f816b40edbaf1b1790918d287
I20260808 17:50:34.224139 4982 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:50:34.242237 4982 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:50:34.242712 4982 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:50:34.254151 4982 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 926690dca1564b2a841ef6a3d8ff55cc: Generated new TSK 0
I20260808 17:50:34.254319 4982 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 17:50:34.277287 5012 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 17:50:34.277417 5012 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 17:50:34.277630 4963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:34.262263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41738 (local address 127.28.213.190:37099)
0808 17:50:34.262299 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:34.262301 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:34.262439 (+ 138us) server_negotiation.cc:407] Connection header received
0808 17:50:34.262511 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:34.262511 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:34.262525 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:34.262600 (+ 75us) server_negotiation.cc:226] Negotiated authn=JWT
0808 17:50:34.262718 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.263491 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.264278 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.264571 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.264634 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:34.264814 (+ 180us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 17:50:34.277421 (+ 12607us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33175/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 17:50:34.277566 (+ 145us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41738: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33175/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":15}
W20260808 17:50:34.277704 4963 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41738: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33175/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 17:50:34.278070 5011 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:34.262181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:37099 (local address 127.0.0.1:41738)
0808 17:50:34.262369 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:34.262378 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:34.262443 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:34.262602 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:34.262602 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:34.262604 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 17:50:34.262667 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:34.262669 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.263575 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.263576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:34.264205 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:34.264208 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.264650 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.264651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:34.264696 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:34.264716 (+ 20us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 17:50:34.277573 (+ 12857us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33175/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 17:50:34.277679 (+ 106us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.28.213.190:37099: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33175/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":83,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.28.213.190:37099: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33175/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 17:50:34.278535 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 4851
2026-08-08T17:50:34Z chronyd exiting
I20260808 17:50:34.323342 29526 test_util.cc:175] -----------------------------------------------
I20260808 17:50:34.323426 29526 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786211411189989-29526-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (251 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 17:50:34.324169 29526 mini_oidc.cc:152] Starting JWKS server
I20260808 17:50:34.324820 29526 webserver.cc:460] Webserver started at https://127.0.0.1:46233/ using document root <none> and password file <none>
I20260808 17:50:34.324860 29526 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 17:50:34.324980 29526 webserver.cc:460] Webserver started at http://127.0.0.1:41359/ using document root <none> and password file <none>
2026-08-08T17:50:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:50:34Z Disabled control of system clock
I20260808 17:50:34.333273 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:46501
--webserver_interface=127.28.213.190
--webserver_port=0
--builtin_ntp_servers=127.28.213.148:44131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:46501
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46233/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786211411189989-29526-0/testchainca.cert with env {}
W20260808 17:50:34.412886 5021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:34.413071 5021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:34.413091 5021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:34.414186 5021 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:34.414220 5021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:34.414232 5021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:34.414243 5021 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:34.414259 5021 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 17:50:34.414271 5021 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 17:50:34.414281 5021 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46233/jwks.json
I20260808 17:50:34.415798 5021 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:44131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:46501
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:46501
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46233/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786211411189989-29526-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:34.415975 5021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:34.416136 5021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:34.420428 5032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:34.420495 5026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:34.420610 5021 server_base.cc:1034] running on GCE node
W20260808 17:50:34.420634 5034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:34.420858 5021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:34.421131 5021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:34.422266 5021 hybrid_clock.cc:648] HybridClock initialized: now 1786211434422255 us; error 43 us; skew 500 ppm
I20260808 17:50:34.423400 5021 webserver.cc:460] Webserver started at http://127.28.213.190:39707/ using document root <none> and password file <none>
I20260808 17:50:34.423609 5021 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:34.423653 5021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:34.423775 5021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:34.424754 5021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "825931c9505446acb71e2c56c0dfe8d9"
format_stamp: "Formatted at 2026-08-08 17:50:34 on dist-test-slave-bndk"
server_key: "ec89be9f636562149304f0792da58136"
server_key_iv: "71fd447edf6c8d595338c5baa627708f"
server_key_version: "encryptionkey@0"
I20260808 17:50:34.425069 5021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "825931c9505446acb71e2c56c0dfe8d9"
format_stamp: "Formatted at 2026-08-08 17:50:34 on dist-test-slave-bndk"
server_key: "ec89be9f636562149304f0792da58136"
server_key_iv: "71fd447edf6c8d595338c5baa627708f"
server_key_version: "encryptionkey@0"
I20260808 17:50:34.426301 5021 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:50:34.426928 5040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:34.427059 5021 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:34.427140 5021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "825931c9505446acb71e2c56c0dfe8d9"
format_stamp: "Formatted at 2026-08-08 17:50:34 on dist-test-slave-bndk"
server_key: "ec89be9f636562149304f0792da58136"
server_key_iv: "71fd447edf6c8d595338c5baa627708f"
server_key_version: "encryptionkey@0"
I20260808 17:50:34.427201 5021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:34.436985 5021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:34.437261 5021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:34.437391 5021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:34.440982 5021 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:46501
I20260808 17:50:34.441012 5126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:46501 every 8 connection(s)
I20260808 17:50:34.441334 5021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:50:34.441946 5128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:34.444295 5128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9: Bootstrap starting.
I20260808 17:50:34.444783 5128 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:34.445012 5128 log.cc:824] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:34.445685 5128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9: No bootstrap required, opened a new log
I20260808 17:50:34.447146 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 5021
I20260808 17:50:34.447242 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:50:34.447145 5128 raft_consensus.cc:348] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "825931c9505446acb71e2c56c0dfe8d9" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 46501 } }
I20260808 17:50:34.447268 5128 raft_consensus.cc:374] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:34.447311 5128 raft_consensus.cc:729] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 825931c9505446acb71e2c56c0dfe8d9, State: Initialized, Role: FOLLOWER
I20260808 17:50:34.447422 29526 external_mini_cluster.cc:1428] Setting key c6a394b5494f483eb92eda53078fab1c
I20260808 17:50:34.447444 5128 consensus_queue.cc:260] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "825931c9505446acb71e2c56c0dfe8d9" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 46501 } }
I20260808 17:50:34.447520 5128 raft_consensus.cc:388] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:50:34.447590 5128 raft_consensus.cc:482] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:50:34.447641 5128 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:34.448412 5128 raft_consensus.cc:504] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "825931c9505446acb71e2c56c0dfe8d9" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 46501 } }
I20260808 17:50:34.448521 5128 leader_election.cc:302] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 825931c9505446acb71e2c56c0dfe8d9; no voters:
I20260808 17:50:34.448680 5128 leader_election.cc:288] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:50:34.448843 5133 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:34.448932 5128 sys_catalog.cc:564] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:34.448992 5133 raft_consensus.cc:686] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9 [term 1 LEADER]: Becoming Leader. State: Replica: 825931c9505446acb71e2c56c0dfe8d9, State: Running, Role: LEADER
I20260808 17:50:34.449120 5133 consensus_queue.cc:237] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "825931c9505446acb71e2c56c0dfe8d9" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 46501 } }
I20260808 17:50:34.449508 5134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "825931c9505446acb71e2c56c0dfe8d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "825931c9505446acb71e2c56c0dfe8d9" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 46501 } } }
I20260808 17:50:34.449525 5135 sys_catalog.cc:455] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 825931c9505446acb71e2c56c0dfe8d9. Latest consensus state: current_term: 1 leader_uuid: "825931c9505446acb71e2c56c0dfe8d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "825931c9505446acb71e2c56c0dfe8d9" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 46501 } } }
I20260808 17:50:34.449597 5134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:34.449621 5135 sys_catalog.cc:458] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:34.450361 5145 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:50:34.450958 5145 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:50:34.452555 5145 catalog_manager.cc:1347] Generated new cluster ID: 3ad612a0b27747258e8ec5abb666ccf1
I20260808 17:50:34.452644 5145 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:50:34.452708 5132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:34.447786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57310 (local address 127.28.213.190:46501)
0808 17:50:34.447984 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:34.447991 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:34.448015 (+ 24us) server_negotiation.cc:407] Connection header received
0808 17:50:34.448107 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:34.448111 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:34.448165 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:34.448264 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:34.448501 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.449635 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.450666 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.451162 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.451289 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:34.451884 (+ 595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:34.451888 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:34.451888 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:50:34.452090 (+ 202us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:34.452128 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:50:34.452139 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:34.452196 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:34.452370 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 17:50:34.452458 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":91,"threads_started":1}
I20260808 17:50:34.453625 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:50:34.466843 5145 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:50:34.467279 5145 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:50:34.472388 5145 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 825931c9505446acb71e2c56c0dfe8d9: Generated new TSK 0
I20260808 17:50:34.472539 5145 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 17:50:34.494186 5167 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 17:50:34.494295 5167 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 17:50:34.494562 5132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:34.480001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57326 (local address 127.28.213.190:46501)
0808 17:50:34.480126 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:34.480128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:34.480217 (+ 89us) server_negotiation.cc:407] Connection header received
0808 17:50:34.480298 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:34.480298 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:34.480311 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:34.480378 (+ 67us) server_negotiation.cc:226] Negotiated authn=JWT
0808 17:50:34.480583 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.481404 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.482484 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.482806 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.482864 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:34.483063 (+ 199us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 17:50:34.494365 (+ 11302us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46233/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 17:50:34.494504 (+ 139us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57326: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46233/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":103}
W20260808 17:50:34.494618 5132 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57326: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46233/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 17:50:34.494625 5165 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:34.479968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:46501 (local address 127.0.0.1:57326)
0808 17:50:34.480140 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:34.480151 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:34.480237 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:34.480435 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:34.480436 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:34.480439 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0808 17:50:34.480496 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:34.480499 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.481500 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.481501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:34.482397 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:34.482401 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.482905 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.482907 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:34.482968 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:34.482974 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 17:50:34.494449 (+ 11475us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46233/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 17:50:34.494543 (+ 94us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.28.213.190:46501: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46233/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":97,"threads_started":1}
I20260808 17:50:34.494855 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 5021
2026-08-08T17:50:34Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (215 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 17:50:34.539754 29526 mini_oidc.cc:152] Starting JWKS server
I20260808 17:50:34.540387 29526 webserver.cc:460] Webserver started at https://127.0.0.1:34055/ using document root <none> and password file <none>
I20260808 17:50:34.540437 29526 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 17:50:34.540578 29526 webserver.cc:460] Webserver started at http://127.0.0.1:33301/ using document root <none> and password file <none>
2026-08-08T17:50:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:50:34Z Disabled control of system clock
I20260808 17:50:34.548473 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:45551
--webserver_interface=127.28.213.190
--webserver_port=0
--builtin_ntp_servers=127.28.213.148:39541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:45551
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34055/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 17:50:34.627105 5175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:34.627292 5175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:34.627321 5175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:34.628448 5175 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:34.628487 5175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:34.628505 5175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:34.628522 5175 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:34.628537 5175 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 17:50:34.628561 5175 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 17:50:34.628585 5175 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34055/jwks.json
I20260808 17:50:34.629957 5175 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:39541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:45551
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:45551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34055/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:34.630189 5175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:34.630452 5175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:34.634840 5185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:34.634966 5175 server_base.cc:1034] running on GCE node
W20260808 17:50:34.634886 5187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:34.635093 5191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:34.635315 5175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:34.635567 5175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:34.636701 5175 hybrid_clock.cc:648] HybridClock initialized: now 1786211434636679 us; error 36 us; skew 500 ppm
I20260808 17:50:34.637842 5175 webserver.cc:460] Webserver started at http://127.28.213.190:41247/ using document root <none> and password file <none>
I20260808 17:50:34.638067 5175 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:34.638111 5175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:34.638239 5175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:34.639204 5175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "7cd234eb2c5844188d152cba91bfce8c"
format_stamp: "Formatted at 2026-08-08 17:50:34 on dist-test-slave-bndk"
server_key: "d0cde5a69ddad83a39de522dee83bf0c"
server_key_iv: "c2725b940b91b51c1a02ae47885abebd"
server_key_version: "encryptionkey@0"
I20260808 17:50:34.639523 5175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "7cd234eb2c5844188d152cba91bfce8c"
format_stamp: "Formatted at 2026-08-08 17:50:34 on dist-test-slave-bndk"
server_key: "d0cde5a69ddad83a39de522dee83bf0c"
server_key_iv: "c2725b940b91b51c1a02ae47885abebd"
server_key_version: "encryptionkey@0"
I20260808 17:50:34.640669 5175 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:50:34.641366 5198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:34.641515 5175 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:34.641597 5175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "7cd234eb2c5844188d152cba91bfce8c"
format_stamp: "Formatted at 2026-08-08 17:50:34 on dist-test-slave-bndk"
server_key: "d0cde5a69ddad83a39de522dee83bf0c"
server_key_iv: "c2725b940b91b51c1a02ae47885abebd"
server_key_version: "encryptionkey@0"
I20260808 17:50:34.641662 5175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:34.653684 5175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:34.653930 5175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:34.654048 5175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:34.657678 5175 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:45551
I20260808 17:50:34.657707 5274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:45551 every 8 connection(s)
I20260808 17:50:34.657992 5175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:50:34.658581 5275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:34.660873 5275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c: Bootstrap starting.
I20260808 17:50:34.661435 5275 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:34.661680 5275 log.cc:824] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:34.662158 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 5175
I20260808 17:50:34.662235 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:50:34.662338 5275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c: No bootstrap required, opened a new log
I20260808 17:50:34.662391 29526 external_mini_cluster.cc:1428] Setting key fae7cf8cb7f0f21013f47807c4a99526
I20260808 17:50:34.664364 5275 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cd234eb2c5844188d152cba91bfce8c" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 45551 } }
I20260808 17:50:34.664491 5275 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:34.664523 5275 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cd234eb2c5844188d152cba91bfce8c, State: Initialized, Role: FOLLOWER
I20260808 17:50:34.664642 5275 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cd234eb2c5844188d152cba91bfce8c" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 45551 } }
I20260808 17:50:34.664722 5275 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:50:34.664754 5275 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:50:34.664799 5275 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:34.665366 5275 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cd234eb2c5844188d152cba91bfce8c" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 45551 } }
I20260808 17:50:34.665467 5275 leader_election.cc:302] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7cd234eb2c5844188d152cba91bfce8c; no voters:
I20260808 17:50:34.665628 5275 leader_election.cc:288] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:50:34.665663 5281 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:34.665759 5281 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c [term 1 LEADER]: Becoming Leader. State: Replica: 7cd234eb2c5844188d152cba91bfce8c, State: Running, Role: LEADER
I20260808 17:50:34.665875 5275 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:34.665899 5281 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cd234eb2c5844188d152cba91bfce8c" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 45551 } }
I20260808 17:50:34.666265 5282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7cd234eb2c5844188d152cba91bfce8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cd234eb2c5844188d152cba91bfce8c" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 45551 } } }
I20260808 17:50:34.666347 5282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:34.666558 5283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7cd234eb2c5844188d152cba91bfce8c. Latest consensus state: current_term: 1 leader_uuid: "7cd234eb2c5844188d152cba91bfce8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cd234eb2c5844188d152cba91bfce8c" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 45551 } } }
I20260808 17:50:34.666667 5283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:34.666950 5293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:50:34.667456 5293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:50:34.668661 5280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:34.662810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45934 (local address 127.28.213.190:45551)
0808 17:50:34.662988 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:34.662995 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:34.663018 (+ 23us) server_negotiation.cc:407] Connection header received
0808 17:50:34.663519 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:34.663525 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:34.663580 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:34.663681 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:34.663898 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.665417 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.666444 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.667028 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.667117 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:34.668004 (+ 887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:34.668007 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:34.668008 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:50:34.668184 (+ 176us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:34.668226 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:50:34.668240 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:34.668309 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:34.668395 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 17:50:34.668471 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":63,"threads_started":1}
I20260808 17:50:34.669392 5293 catalog_manager.cc:1347] Generated new cluster ID: 50ad732901cf4cb48cb388df2a7f9850
I20260808 17:50:34.669446 5293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:50:34.669559 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:50:34.686050 5293 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:50:34.686594 5293 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:50:34.693430 5293 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7cd234eb2c5844188d152cba91bfce8c: Generated new TSK 0
I20260808 17:50:34.693576 5293 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:50:34.710063 5280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:34.706483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45950 (local address 127.28.213.190:45551)
0808 17:50:34.706522 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:34.706524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:34.706602 (+ 78us) server_negotiation.cc:407] Connection header received
0808 17:50:34.706651 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:34.706651 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:34.706663 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:34.706742 (+ 79us) server_negotiation.cc:226] Negotiated authn=JWT
0808 17:50:34.706846 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.707629 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.708364 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.708678 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.708743 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:34.708873 (+ 130us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 17:50:34.709794 (+ 921us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34055/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 17:50:34.709969 (+ 175us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45950: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34055/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 17:50:34.710119 5280 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45950: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34055/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 17:50:34.711799 5326 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:34.706400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:45551 (local address 127.0.0.1:45950)
0808 17:50:34.706542 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:34.706551 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:34.706601 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:34.706740 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:34.706741 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:34.706742 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0808 17:50:34.706785 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:34.706786 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.707696 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.707697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:34.708294 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:34.708295 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.708743 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.708743 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:34.708779 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:34.708783 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 17:50:34.709898 (+ 1115us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34055/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 17:50:34.711708 (+ 1810us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.28.213.190:45551: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34055/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":1645,"thread_start_us":89,"threads_started":1}
I20260808 17:50:34.711943 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 5175
E20260808 17:50:34.728631 5327 webserver.cc:533] Webserver: sslize failed:
E20260808 17:50:34.728693 5327 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T17:50:34Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (217 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T17:50:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:50:34Z Disabled control of system clock
I20260808 17:50:34.764791 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:34463
--webserver_interface=127.28.213.190
--webserver_port=0
--builtin_ntp_servers=127.28.213.148:44619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:34463
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786211411189989-29526-0/testchainca.cert with env {}
W20260808 17:50:34.843055 5333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:34.843231 5333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:34.843251 5333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:34.844372 5333 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:34.844413 5333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:34.844424 5333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:34.844447 5333 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:34.844470 5333 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 17:50:34.844491 5333 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 17:50:34.844513 5333 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 17:50:34.845991 5333 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:44619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:34463
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:34463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786211411189989-29526-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:34.846201 5333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:34.846378 5333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:34.850703 5339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:34.850713 5338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:34.850742 5333 server_base.cc:1034] running on GCE node
W20260808 17:50:34.850713 5341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:34.851100 5333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:34.851374 5333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:34.852528 5333 hybrid_clock.cc:648] HybridClock initialized: now 1786211434852514 us; error 31 us; skew 500 ppm
I20260808 17:50:34.853618 5333 webserver.cc:460] Webserver started at http://127.28.213.190:46271/ using document root <none> and password file <none>
I20260808 17:50:34.853854 5333 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:34.853899 5333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:34.854013 5333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:34.854959 5333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "845d87345ccb464aa896ed31ccb90bf5"
format_stamp: "Formatted at 2026-08-08 17:50:34 on dist-test-slave-bndk"
server_key: "00fa06f35a77d25a3f088e63585c63c3"
server_key_iv: "d4757536f8380741288d9bf618a59b8c"
server_key_version: "encryptionkey@0"
I20260808 17:50:34.855268 5333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "845d87345ccb464aa896ed31ccb90bf5"
format_stamp: "Formatted at 2026-08-08 17:50:34 on dist-test-slave-bndk"
server_key: "00fa06f35a77d25a3f088e63585c63c3"
server_key_iv: "d4757536f8380741288d9bf618a59b8c"
server_key_version: "encryptionkey@0"
I20260808 17:50:34.856395 5333 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:50:34.857030 5349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:34.857156 5333 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:34.857259 5333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "845d87345ccb464aa896ed31ccb90bf5"
format_stamp: "Formatted at 2026-08-08 17:50:34 on dist-test-slave-bndk"
server_key: "00fa06f35a77d25a3f088e63585c63c3"
server_key_iv: "d4757536f8380741288d9bf618a59b8c"
server_key_version: "encryptionkey@0"
I20260808 17:50:34.857317 5333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:34.882982 5333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:34.883224 5333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:34.883347 5333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:34.886942 5333 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:34463
I20260808 17:50:34.886981 5421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:34463 every 8 connection(s)
I20260808 17:50:34.887251 5333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:50:34.888150 5422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:34.888703 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 5333
I20260808 17:50:34.888808 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:50:34.889010 29526 external_mini_cluster.cc:1428] Setting key 2ad02cd9705df8701522a449727649e9
I20260808 17:50:34.890765 5422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5: Bootstrap starting.
I20260808 17:50:34.891345 5422 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:34.891655 5422 log.cc:824] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:34.892351 5422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5: No bootstrap required, opened a new log
I20260808 17:50:34.893946 5426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:34.889464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48752 (local address 127.28.213.190:34463)
0808 17:50:34.889638 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:34.889645 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:34.889668 (+ 23us) server_negotiation.cc:407] Connection header received
0808 17:50:34.890054 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:34.890060 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:34.890115 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:34.890220 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:34.890460 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.891319 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.892266 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.892678 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.892761 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:34.893384 (+ 623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:34.893388 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:34.893388 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:50:34.893539 (+ 151us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:34.893568 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:50:34.893578 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:34.893622 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:34.893710 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 17:50:34.893766 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":62,"threads_started":1}
I20260808 17:50:34.894395 5422 raft_consensus.cc:348] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "845d87345ccb464aa896ed31ccb90bf5" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 34463 } }
I20260808 17:50:34.894555 5422 raft_consensus.cc:374] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:34.894583 5422 raft_consensus.cc:729] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 845d87345ccb464aa896ed31ccb90bf5, State: Initialized, Role: FOLLOWER
I20260808 17:50:34.894707 5422 consensus_queue.cc:260] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "845d87345ccb464aa896ed31ccb90bf5" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 34463 } }
I20260808 17:50:34.894773 5422 raft_consensus.cc:388] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:50:34.894804 5422 raft_consensus.cc:482] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:50:34.894841 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:50:34.894871 5422 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:34.895364 5422 raft_consensus.cc:504] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "845d87345ccb464aa896ed31ccb90bf5" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 34463 } }
I20260808 17:50:34.895462 5422 leader_election.cc:302] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 845d87345ccb464aa896ed31ccb90bf5; no voters:
I20260808 17:50:34.895617 5422 leader_election.cc:288] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:50:34.895666 5428 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:34.895780 5428 raft_consensus.cc:686] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 845d87345ccb464aa896ed31ccb90bf5, State: Running, Role: LEADER
I20260808 17:50:34.895851 5422 sys_catalog.cc:564] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:34.895860 5428 consensus_queue.cc:237] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "845d87345ccb464aa896ed31ccb90bf5" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 34463 } }
I20260808 17:50:34.896198 5428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 845d87345ccb464aa896ed31ccb90bf5. Latest consensus state: current_term: 1 leader_uuid: "845d87345ccb464aa896ed31ccb90bf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "845d87345ccb464aa896ed31ccb90bf5" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 34463 } } }
I20260808 17:50:34.896229 5432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "845d87345ccb464aa896ed31ccb90bf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "845d87345ccb464aa896ed31ccb90bf5" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 34463 } } }
I20260808 17:50:34.896341 5428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:34.896385 5432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:34.896816 5441 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:50:34.897320 5441 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:50:34.898696 5441 catalog_manager.cc:1347] Generated new cluster ID: da34a0a2a76e4a809b59c83d4543650e
I20260808 17:50:34.898739 5441 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:50:34.910930 5441 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:50:34.911388 5441 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:50:34.916354 5441 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 845d87345ccb464aa896ed31ccb90bf5: Generated new TSK 0
I20260808 17:50:34.916486 5441 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:50:34.935285 5426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:34.924920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48754 (local address 127.28.213.190:34463)
0808 17:50:34.924965 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:34.924968 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:34.925058 (+ 90us) server_negotiation.cc:407] Connection header received
0808 17:50:34.925132 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:34.925133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:34.925145 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:34.925203 (+ 58us) server_negotiation.cc:226] Negotiated authn=JWT
0808 17:50:34.925334 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.925818 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.926577 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.926768 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.926820 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:34.926983 (+ 163us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 17:50:34.935096 (+ 8113us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 17:50:34.935224 (+ 128us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48754: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":24}
W20260808 17:50:34.935343 5426 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48754: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 17:50:34.935367 5463 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:34.924861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:34463 (local address 127.0.0.1:48754)
0808 17:50:34.924996 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:34.925006 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:34.925066 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:34.925206 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:34.925207 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:34.925209 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 17:50:34.925276 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:34.925278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.925889 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.925890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:34.926504 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:34.926506 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:34.926832 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:34.926833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:34.926891 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:34.926896 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 17:50:34.935194 (+ 8298us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 17:50:34.935284 (+ 90us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.28.213.190:34463: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":87,"threads_started":1}
I20260808 17:50:34.935675 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 5333
2026-08-08T17:50:34Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (216 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (88 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (85 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:50:35 dist-test-slave-bndk krb5kdc[5483](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:50:35 dist-test-slave-bndk krb5kdc[5483](info): set up 2 sockets
Aug 08 17:50:35 dist-test-slave-bndk krb5kdc[5483](info): commencing operation
krb5kdc: starting...
W20260808 17:50:36.251444 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:50:36 dist-test-slave-bndk krb5kdc[5483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:50:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:50:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:50:36.360693 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:40531
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:38155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:40531
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:36.439199 5504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:36.439385 5504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:36.439414 5504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:36.440479 5504 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:36.440511 5504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:36.440524 5504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:36.440536 5504 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:36.440546 5504 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:50:36.441951 5504 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:38155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:40531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:40531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5504
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:36.442131 5504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:36.442291 5504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 17:50:36.446687 5504 server_base.cc:1034] running on GCE node
W20260808 17:50:36.446619 5511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:36.446619 5514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:36.446627 5510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:36.447139 5504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:36.447417 5504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:36.448565 5504 hybrid_clock.cc:648] HybridClock initialized: now 1786211436448551 us; error 31 us; skew 500 ppm
Aug 08 17:50:36 dist-test-slave-bndk krb5kdc[5483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211436, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:36.450855 5504 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:50:36.451211 5504 webserver.cc:460] Webserver started at http://127.28.213.190:35439/ using document root <none> and password file <none>
I20260808 17:50:36.451419 5504 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:36.451458 5504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:36.451548 5504 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:36.452454 5504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "7cf72f0f41614ceb935da5f63ed98a6a"
format_stamp: "Formatted at 2026-08-08 17:50:36 on dist-test-slave-bndk"
server_key: "89fb3147becff7c3bfd7ad1b1ce7e424"
server_key_iv: "31113a4094a089e673f4dde3d72234f0"
server_key_version: "encryptionkey@0"
I20260808 17:50:36.452739 5504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "7cf72f0f41614ceb935da5f63ed98a6a"
format_stamp: "Formatted at 2026-08-08 17:50:36 on dist-test-slave-bndk"
server_key: "89fb3147becff7c3bfd7ad1b1ce7e424"
server_key_iv: "31113a4094a089e673f4dde3d72234f0"
server_key_version: "encryptionkey@0"
I20260808 17:50:36.453929 5504 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:50:36.454559 5525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:36.454710 5504 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:36.454787 5504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "7cf72f0f41614ceb935da5f63ed98a6a"
format_stamp: "Formatted at 2026-08-08 17:50:36 on dist-test-slave-bndk"
server_key: "89fb3147becff7c3bfd7ad1b1ce7e424"
server_key_iv: "31113a4094a089e673f4dde3d72234f0"
server_key_version: "encryptionkey@0"
I20260808 17:50:36.454840 5504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:36.464448 5504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:36.466023 5504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:36.466122 5504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:36.469827 5504 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:40531
I20260808 17:50:36.469861 5607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:40531 every 8 connection(s)
I20260808 17:50:36.470149 5504 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:50:36.470927 5608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:36.473018 5608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a: Bootstrap starting.
I20260808 17:50:36.473585 5608 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:36.473852 5608 log.cc:824] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:36.474403 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 5504
I20260808 17:50:36.474468 5608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a: No bootstrap required, opened a new log
I20260808 17:50:36.474507 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:50:36.474658 29526 external_mini_cluster.cc:1428] Setting key a3d11b6d94e5dde995fd873136cdce0e
I20260808 17:50:36.476549 5608 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cf72f0f41614ceb935da5f63ed98a6a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40531 } }
I20260808 17:50:36.476679 5608 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:36.476701 5608 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cf72f0f41614ceb935da5f63ed98a6a, State: Initialized, Role: FOLLOWER
I20260808 17:50:36.476804 5608 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cf72f0f41614ceb935da5f63ed98a6a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40531 } }
I20260808 17:50:36.476863 5608 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:50:36.476887 5608 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:50:36.476939 5608 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:36.477480 5608 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cf72f0f41614ceb935da5f63ed98a6a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40531 } }
I20260808 17:50:36.477572 5608 leader_election.cc:302] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7cf72f0f41614ceb935da5f63ed98a6a; no voters:
I20260808 17:50:36.477717 5608 leader_election.cc:288] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:50:36.477754 5618 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:36.477918 5618 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a [term 1 LEADER]: Becoming Leader. State: Replica: 7cf72f0f41614ceb935da5f63ed98a6a, State: Running, Role: LEADER
I20260808 17:50:36.477977 5608 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:36.478048 5618 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cf72f0f41614ceb935da5f63ed98a6a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40531 } }
I20260808 17:50:36.478468 5619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7cf72f0f41614ceb935da5f63ed98a6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cf72f0f41614ceb935da5f63ed98a6a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40531 } } }
I20260808 17:50:36.478554 5619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:36.478936 5620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7cf72f0f41614ceb935da5f63ed98a6a. Latest consensus state: current_term: 1 leader_uuid: "7cf72f0f41614ceb935da5f63ed98a6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cf72f0f41614ceb935da5f63ed98a6a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40531 } } }
I20260808 17:50:36.479013 5620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:36.479182 5629 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:50:36.479667 5629 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:50:36.481156 5629 catalog_manager.cc:1347] Generated new cluster ID: 15fda1e127ce45f3834cd9a399545819
I20260808 17:50:36.481204 5629 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:50:36 dist-test-slave-bndk krb5kdc[5483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:36.485984 5617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:36.475093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48078 (local address 127.28.213.190:40531)
0808 17:50:36.475251 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:36.475258 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:36.475281 (+ 23us) server_negotiation.cc:407] Connection header received
0808 17:50:36.475664 (+ 383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:36.475669 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:36.475712 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:36.475813 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:36.476542 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:36.477785 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:36.478768 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:36.479322 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:36.479429 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:36.482137 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:36.482142 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:36.482142 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:36.482155 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:36.483952 (+ 1797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:36.484342 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:36.484345 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:36.484346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:36.484457 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:36.484664 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:36.484665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:36.484665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:36.484950 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:36.485098 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:36.485653 (+ 555us) server_negotiation.cc:299] Negotiation successful
0808 17:50:36.485795 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":68,"threads_started":1}
I20260808 17:50:36.498059 5629 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:50:36.498519 5629 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:50:36.509586 5629 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7cf72f0f41614ceb935da5f63ed98a6a: Generated new TSK 0
I20260808 17:50:36.509742 5629 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
I20260808 17:50:36.535175 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:40531
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:38155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:36.614758 5646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:36.614943 5646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:36.614964 5646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:36.616061 5646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:36.616101 5646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:36.616127 5646 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:50:36.617587 5646 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:38155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:40531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5646
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:36.617802 5646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:36.618012 5646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:36.622568 5651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:36.622571 5652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:36.622777 5646 server_base.cc:1034] running on GCE node
W20260808 17:50:36.622608 5655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:36.623056 5646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:36.623266 5646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:36.624404 5646 hybrid_clock.cc:648] HybridClock initialized: now 1786211436624395 us; error 30 us; skew 500 ppm
Aug 08 17:50:36 dist-test-slave-bndk krb5kdc[5483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211436, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:36.626801 5646 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:50:36.627169 5646 webserver.cc:460] Webserver started at http://127.28.213.129:36091/ using document root <none> and password file <none>
I20260808 17:50:36.627348 5646 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:36.627386 5646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:36.627478 5646 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:36.628401 5646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "de37dc6bfbec49b28d3bb46040e90381"
format_stamp: "Formatted at 2026-08-08 17:50:36 on dist-test-slave-bndk"
server_key: "43e749e611e8c0ac0f16e077bf0c5544"
server_key_iv: "a3b900483b25abbd5f8e8741683466ee"
server_key_version: "encryptionkey@0"
I20260808 17:50:36.628687 5646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "de37dc6bfbec49b28d3bb46040e90381"
format_stamp: "Formatted at 2026-08-08 17:50:36 on dist-test-slave-bndk"
server_key: "43e749e611e8c0ac0f16e077bf0c5544"
server_key_iv: "a3b900483b25abbd5f8e8741683466ee"
server_key_version: "encryptionkey@0"
I20260808 17:50:36.629894 5646 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:50:36.630532 5668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:36.630693 5646 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:36.630775 5646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "de37dc6bfbec49b28d3bb46040e90381"
format_stamp: "Formatted at 2026-08-08 17:50:36 on dist-test-slave-bndk"
server_key: "43e749e611e8c0ac0f16e077bf0c5544"
server_key_iv: "a3b900483b25abbd5f8e8741683466ee"
server_key_version: "encryptionkey@0"
I20260808 17:50:36.630827 5646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:36.638669 5646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:36.640164 5646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:36.640264 5646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:36.640416 5646 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:36.640635 5646 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:36.640662 5646 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:36.640681 5646 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:36.640697 5646 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:36.646054 5646 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:42763
I20260808 17:50:36.646121 5830 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:42763 every 8 connection(s)
I20260808 17:50:36.646359 5646 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:50:36.649448 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 5646
I20260808 17:50:36.649541 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:50:36.649724 29526 external_mini_cluster.cc:1428] Setting key 69cd63cc3bc2ea86253cca5d95267f6e
Aug 08 17:50:36 dist-test-slave-bndk krb5kdc[5483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211436, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:36.655283 5617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:36.646989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:52943 (local address 127.28.213.190:40531)
0808 17:50:36.647032 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:36.647034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:36.647197 (+ 163us) server_negotiation.cc:407] Connection header received
0808 17:50:36.648165 (+ 968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:36.648167 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:36.648180 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:36.648230 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:36.648802 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:36.649379 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:36.650535 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:36.650754 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:36.650805 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:36.652783 (+ 1978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:36.652785 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:36.652785 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:36.652792 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:36.654039 (+ 1247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:36.654404 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:36.654405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:36.654405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:36.654466 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:36.654680 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:36.654681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:36.654681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:36.654793 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:36.654848 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:36.655102 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 17:50:36.655192 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:50:36.655405 5833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:36.646948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40531 (local address 127.28.213.129:52943)
0808 17:50:36.647083 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:36.647122 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:36.648065 (+ 943us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:36.648294 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:36.648298 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:36.648536 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:36.648710 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:36.648714 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:36.649462 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:36.649463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:36.650450 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:36.650452 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:36.650818 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:36.650819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:36.650943 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:36.651363 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:36.651370 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:36.652693 (+ 1323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:36.654115 (+ 1422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:36.654122 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:36.654124 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:36.654335 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:36.654523 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:36.654524 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:36.654524 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:36.654624 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:36.654854 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:36.654861 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:36.654984 (+ 123us) client_negotiation.cc:769] Sending connection context
0808 17:50:36.655071 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 17:50:36.655209 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":68,"threads_started":1}
I20260808 17:50:36.655797 5831 heartbeater.cc:347] Connected to a master server at 127.28.213.190:40531
I20260808 17:50:36.655887 5831 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:36.656044 5831 heartbeater.cc:511] Master 127.28.213.190:40531 requested a full tablet report, sending...
I20260808 17:50:36.656533 5547 ts_manager.cc:194] Registered new tserver with Master: de37dc6bfbec49b28d3bb46040e90381 (127.28.213.129:42763)
I20260808 17:50:36.657115 5547 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:52943
WARNING: no policy specified for kudu/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
I20260808 17:50:36.673182 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:40531
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:38155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:36.751993 5837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:36.752177 5837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:36.752198 5837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:36.753298 5837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:36.753342 5837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:36.753367 5837 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:50:36.754762 5837 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:38155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:40531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:36.754931 5837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:36.755106 5837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:36.759650 5842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:36.759651 5843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:36.759651 5846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:36.759817 5837 server_base.cc:1034] running on GCE node
I20260808 17:50:36.760013 5837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:36.760203 5837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:36.761319 5837 hybrid_clock.cc:648] HybridClock initialized: now 1786211436761310 us; error 26 us; skew 500 ppm
Aug 08 17:50:36 dist-test-slave-bndk krb5kdc[5483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211436, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:36.763602 5837 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:50:36.764006 5837 webserver.cc:460] Webserver started at http://127.28.213.130:45233/ using document root <none> and password file <none>
I20260808 17:50:36.764192 5837 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:36.764233 5837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:36.764359 5837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:36.765434 5837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "39c2e2f2171f45819ad78b0f5927ef49"
format_stamp: "Formatted at 2026-08-08 17:50:36 on dist-test-slave-bndk"
server_key: "f7d626c05d57bd8d23a6ea06256cc2f7"
server_key_iv: "7e65b3589f353ba374622db73693ddff"
server_key_version: "encryptionkey@0"
I20260808 17:50:36.765749 5837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "39c2e2f2171f45819ad78b0f5927ef49"
format_stamp: "Formatted at 2026-08-08 17:50:36 on dist-test-slave-bndk"
server_key: "f7d626c05d57bd8d23a6ea06256cc2f7"
server_key_iv: "7e65b3589f353ba374622db73693ddff"
server_key_version: "encryptionkey@0"
I20260808 17:50:36.766937 5837 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:36.767609 5856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:36.767750 5837 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:36.767827 5837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "39c2e2f2171f45819ad78b0f5927ef49"
format_stamp: "Formatted at 2026-08-08 17:50:36 on dist-test-slave-bndk"
server_key: "f7d626c05d57bd8d23a6ea06256cc2f7"
server_key_iv: "7e65b3589f353ba374622db73693ddff"
server_key_version: "encryptionkey@0"
I20260808 17:50:36.767891 5837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:36.780251 5837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:36.781863 5837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:36.781980 5837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:36.782163 5837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:36.782434 5837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:36.782467 5837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:36.782495 5837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:36.782518 5837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:36.787906 5837 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:41603
I20260808 17:50:36.787964 6032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:41603 every 8 connection(s)
I20260808 17:50:36.788220 5837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
Aug 08 17:50:36 dist-test-slave-bndk krb5kdc[5483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211436, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:36.796283 5617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:36.788823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:32791 (local address 127.28.213.190:40531)
0808 17:50:36.788892 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:36.788895 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:36.789044 (+ 149us) server_negotiation.cc:407] Connection header received
0808 17:50:36.790080 (+ 1036us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:36.790082 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:36.790095 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:36.790162 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:36.790751 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:36.791237 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:36.792211 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:36.792410 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:36.792458 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:36.794259 (+ 1801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:36.794260 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:36.794261 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:36.794267 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:36.795308 (+ 1041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:36.795630 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:36.795631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:36.795631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:36.795674 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:36.795838 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:36.795838 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:36.795839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:36.795932 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:36.795977 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:36.796162 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 17:50:36.796221 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 17:50:36.796412 6035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:36.788783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40531 (local address 127.28.213.130:32791)
0808 17:50:36.788936 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:36.788969 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:36.789981 (+ 1012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:36.790225 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:36.790229 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:36.790505 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:36.790674 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:36.790679 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:36.791337 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:36.791338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:36.792134 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:36.792136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:36.792464 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:36.792465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:36.792550 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:36.792903 (+ 353us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:36.792918 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:36.794176 (+ 1258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:36.795370 (+ 1194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:36.795375 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:36.795377 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:36.795575 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:36.795717 (+ 142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:36.795717 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:36.795717 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:36.795798 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:36.795974 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:36.795977 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:36.796074 (+ 97us) client_negotiation.cc:769] Sending connection context
0808 17:50:36.796144 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 17:50:36.796250 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":77,"threads_started":1}
I20260808 17:50:36.796850 6033 heartbeater.cc:347] Connected to a master server at 127.28.213.190:40531
I20260808 17:50:36.796934 6033 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:36.797093 6033 heartbeater.cc:511] Master 127.28.213.190:40531 requested a full tablet report, sending...
I20260808 17:50:36.797461 5547 ts_manager.cc:194] Registered new tserver with Master: 39c2e2f2171f45819ad78b0f5927ef49 (127.28.213.130:41603)
I20260808 17:50:36.797513 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 5837
I20260808 17:50:36.797612 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:50:36.797788 29526 external_mini_cluster.cc:1428] Setting key ddfc0cea777d97a7098cc02c0f46e8dd
I20260808 17:50:36.797884 5547 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:32791
WARNING: no policy specified for kudu/127.28.213.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
I20260808 17:50:36.820230 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:40531
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:38155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:36.898140 6038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:36.898325 6038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:36.898355 6038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:36.899461 6038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:36.899500 6038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:36.899534 6038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:50:36.900935 6038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:38155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:40531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:36.901147 6038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:36.901377 6038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:36.905874 6046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:36.905850 6048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:36.905846 6045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:36.906037 6038 server_base.cc:1034] running on GCE node
I20260808 17:50:36.906275 6038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:36.906492 6038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:36.907620 6038 hybrid_clock.cc:648] HybridClock initialized: now 1786211436907602 us; error 31 us; skew 500 ppm
Aug 08 17:50:36 dist-test-slave-bndk krb5kdc[5483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211436, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:36.909871 6038 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:50:36.910245 6038 webserver.cc:460] Webserver started at http://127.28.213.131:45083/ using document root <none> and password file <none>
I20260808 17:50:36.910427 6038 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:36.910472 6038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:36.910591 6038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:36.911531 6038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "d70e44a950d14d16a02b2ca07bdb0308"
format_stamp: "Formatted at 2026-08-08 17:50:36 on dist-test-slave-bndk"
server_key: "59a4c5206c1995416a72cf2a5021e9a2"
server_key_iv: "927f5eedf9188913f0cb64181e86b294"
server_key_version: "encryptionkey@0"
I20260808 17:50:36.911844 6038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "d70e44a950d14d16a02b2ca07bdb0308"
format_stamp: "Formatted at 2026-08-08 17:50:36 on dist-test-slave-bndk"
server_key: "59a4c5206c1995416a72cf2a5021e9a2"
server_key_iv: "927f5eedf9188913f0cb64181e86b294"
server_key_version: "encryptionkey@0"
I20260808 17:50:36.912992 6038 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:50:36.913672 6055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:36.913826 6038 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:36.913928 6038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "d70e44a950d14d16a02b2ca07bdb0308"
format_stamp: "Formatted at 2026-08-08 17:50:36 on dist-test-slave-bndk"
server_key: "59a4c5206c1995416a72cf2a5021e9a2"
server_key_iv: "927f5eedf9188913f0cb64181e86b294"
server_key_version: "encryptionkey@0"
I20260808 17:50:36.913993 6038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:36.955569 6038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:36.957697 6038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:36.957818 6038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:36.958016 6038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:36.958321 6038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:36.958354 6038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:36.958377 6038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:36.958400 6038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:36.963866 6038 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:46879
I20260808 17:50:36.963929 6236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:46879 every 8 connection(s)
I20260808 17:50:36.964211 6038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:50:36.964609 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 6038
I20260808 17:50:36.964702 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:50:36.964877 29526 external_mini_cluster.cc:1428] Setting key 738eef0a4633bf6b4058e5007a0bc388
Aug 08 17:50:36 dist-test-slave-bndk krb5kdc[5483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211436, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:36.973397 5617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:36.965270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:44637 (local address 127.28.213.190:40531)
0808 17:50:36.965316 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:36.965318 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:36.965610 (+ 292us) server_negotiation.cc:407] Connection header received
0808 17:50:36.966607 (+ 997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:36.966608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:36.966621 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:36.966671 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:36.967283 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:36.967777 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:36.968790 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:36.968996 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:36.969050 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:36.970970 (+ 1920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:36.970972 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:36.970972 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:36.970979 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:36.972161 (+ 1182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:36.972524 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:36.972525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:36.972526 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:36.972579 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:36.972788 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:36.972789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:36.972789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:36.972895 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:36.972958 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:36.973210 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 17:50:36.973311 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:50:36.973554 6240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:36.965270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40531 (local address 127.28.213.131:44637)
0808 17:50:36.965492 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:36.965541 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:36.966509 (+ 968us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:36.966744 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:36.966748 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:36.967009 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:36.967195 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:36.967200 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:36.967856 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:36.967857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:36.968709 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:36.968712 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:36.969064 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:36.969065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:36.969179 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:36.969576 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:36.969584 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:36.970885 (+ 1301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:36.972232 (+ 1347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:36.972239 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:36.972241 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:36.972456 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:36.972632 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:36.972633 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:36.972633 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:36.972730 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:36.972958 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:36.972964 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:36.973090 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 17:50:36.973176 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 17:50:36.973342 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":88,"threads_started":1}
I20260808 17:50:36.973971 6238 heartbeater.cc:347] Connected to a master server at 127.28.213.190:40531
I20260808 17:50:36.974058 6238 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:36.974195 6238 heartbeater.cc:511] Master 127.28.213.190:40531 requested a full tablet report, sending...
I20260808 17:50:36.974531 5547 ts_manager.cc:194] Registered new tserver with Master: d70e44a950d14d16a02b2ca07bdb0308 (127.28.213.131:46879)
I20260808 17:50:36.974876 5547 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:44637
I20260808 17:50:36.976547 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/test-admin.keytab.
Aug 08 17:50:36 dist-test-slave-bndk krb5kdc[5483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:36.991189 29526 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 17:50:36.992667 6246 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:36.991963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37268 (local address 127.28.213.129:42763)
0808 17:50:36.992166 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:36.992171 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:36.992181 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:50:36.992205 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:36.992207 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:36.992220 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:36.992287 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:36.992592 (+ 305us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37268: BlockingRecv error: recv got EOF from 127.0.0.1:37268 (error 108)
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":115,"threads_started":1}
W20260808 17:50:36.992811 29526 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/krb5cc' of type FILE
Aug 08 17:50:36 dist-test-slave-bndk krb5kdc[5483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:36.993728 29526 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 17:50:36 dist-test-slave-bndk krb5kdc[5483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:36.994495 29526 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 17:50:36 dist-test-slave-bndk krb5kdc[5483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.129@KRBTEST.COM
I20260808 17:50:37.001206 6246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:36.994945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37276 (local address 127.28.213.129:42763)
0808 17:50:36.994999 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:36.995000 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:36.995009 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:50:36.995069 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:36.995070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:36.995081 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:36.995126 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:36.995479 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:36.996164 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:36.996839 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:36.997154 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:36.997228 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:36.998986 (+ 1758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:36.998994 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:36.998995 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:36.999003 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:37.000175 (+ 1172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:37.000478 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:37.000482 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:37.000482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:37.000538 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:37.000701 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:37.000702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:37.000702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:37.000825 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:37.000965 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:37.001032 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 17:50:37.001103 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260808 17:50:37.002753 6246 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:37.002266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37292 (local address 127.28.213.129:42763)
0808 17:50:37.002302 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:37.002303 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:37.002329 (+ 26us) server_negotiation.cc:407] Connection header received
0808 17:50:37.002394 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:37.002395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:37.002416 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:37.002456 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:37.002711 (+ 255us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37292: BlockingRecv error: recv got EOF from 127.0.0.1:37292 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 17:50:37.002812 29526 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/krb5cc' of type FILE
Aug 08 17:50:36 dist-test-slave-bndk krb5kdc[5483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:37.003607 29526 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 17:50:36 dist-test-slave-bndk krb5kdc[5483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:37.004323 29526 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 17:50:37 dist-test-slave-bndk krb5kdc[5483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.129@KRBTEST.COM
I20260808 17:50:37.010274 6246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:37.004734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37296 (local address 127.28.213.129:42763)
0808 17:50:37.004774 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:37.004775 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:37.004841 (+ 66us) server_negotiation.cc:407] Connection header received
0808 17:50:37.004896 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:37.004897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:37.004906 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:37.004951 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:37.005290 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:37.005744 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:37.006369 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:37.006561 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:37.006612 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:37.008276 (+ 1664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:37.008277 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:37.008278 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:37.008284 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:37.009336 (+ 1052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:37.009639 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:37.009640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:37.009640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:37.009687 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:37.009847 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:37.009848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:37.009849 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:37.009948 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:37.010026 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:37.010140 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 17:50:37.010199 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 17:50:37.011528 6246 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:37.011024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37302 (local address 127.28.213.129:42763)
0808 17:50:37.011058 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:37.011060 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:37.011105 (+ 45us) server_negotiation.cc:407] Connection header received
0808 17:50:37.011147 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:37.011148 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:37.011154 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:37.011193 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:37.011491 (+ 298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37302: BlockingRecv error: recv got EOF from 127.0.0.1:37302 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 17:50:37.011547 29526 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786211411189989-29526-0/krb5kdc/krb5cc' of type FILE
Aug 08 17:50:37 dist-test-slave-bndk krb5kdc[5483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:37.012387 29526 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 17:50:37 dist-test-slave-bndk krb5kdc[5483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:37.013109 29526 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 17:50:37 dist-test-slave-bndk krb5kdc[5483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.129@KRBTEST.COM
I20260808 17:50:37.018796 6246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:37.013561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37308 (local address 127.28.213.129:42763)
0808 17:50:37.013612 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:37.013613 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:37.013637 (+ 24us) server_negotiation.cc:407] Connection header received
0808 17:50:37.013683 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:37.013684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:37.013690 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:37.013731 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:37.014022 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:37.014439 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:37.015053 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:37.015216 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:37.015254 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:37.016933 (+ 1679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:37.016934 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:37.016934 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:37.016940 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:37.018056 (+ 1116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:37.018323 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:37.018323 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:37.018323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:37.018365 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:37.018478 (+ 113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:37.018478 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:37.018478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:37.018548 (+ 70us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:37.018603 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:37.018674 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 17:50:37.018726 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:50:37.019328 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 5646
I20260808 17:50:37.031421 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 5837
I20260808 17:50:37.045691 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 6038
I20260808 17:50:37.060020 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 5504
2026-08-08T17:50:37Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1934 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:50:37 dist-test-slave-bndk krb5kdc[6263](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:50:37 dist-test-slave-bndk krb5kdc[6263](info): set up 2 sockets
Aug 08 17:50:37 dist-test-slave-bndk krb5kdc[6263](info): commencing operation
krb5kdc: starting...
W20260808 17:50:38.186439 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:50:38 dist-test-slave-bndk krb5kdc[6263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:50:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:50:38Z Disabled control of system clock
WARNING: no policy specified for oryx/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.190.keytab.
Entry for principal oryx/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.190.keytab.
I20260808 17:50:38.297178 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:38625
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.190.keytab
--principal=oryx/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:42503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:38625
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:38.376807 6283 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:38.377002 6283 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:38.377033 6283 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:38.378170 6283 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:38.378211 6283 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:38.378232 6283 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:38.378247 6283 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:38.378262 6283 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:50:38.379675 6283 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:42503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:38625
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.190.keytab
--principal=oryx/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:38625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6283
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:38.379905 6283 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:38.380110 6283 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:38.384656 6296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:38.384637 6293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:38.384719 6283 server_base.cc:1034] running on GCE node
W20260808 17:50:38.384653 6294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:38.385092 6283 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:38.385380 6283 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:38.386512 6283 hybrid_clock.cc:648] HybridClock initialized: now 1786211438386504 us; error 27 us; skew 500 ppm
Aug 08 17:50:38 dist-test-slave-bndk krb5kdc[6263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211438, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:38.391258 6283 init.cc:377] Logged in from keytab as oryx/127.28.213.190@KRBTEST.COM (short username oryx)
I20260808 17:50:38.391659 6283 webserver.cc:460] Webserver started at http://127.28.213.190:37867/ using document root <none> and password file <none>
I20260808 17:50:38.391844 6283 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:38.391891 6283 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:38.392021 6283 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:38.393009 6283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "5eb0483a734342039cd6818b65d8e432"
format_stamp: "Formatted at 2026-08-08 17:50:38 on dist-test-slave-bndk"
server_key: "f218d978d0ecf8b10f363ac0c0b707b2"
server_key_iv: "4859b61d0efb8390bf2fe14803854a6e"
server_key_version: "encryptionkey@0"
I20260808 17:50:38.393357 6283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "5eb0483a734342039cd6818b65d8e432"
format_stamp: "Formatted at 2026-08-08 17:50:38 on dist-test-slave-bndk"
server_key: "f218d978d0ecf8b10f363ac0c0b707b2"
server_key_iv: "4859b61d0efb8390bf2fe14803854a6e"
server_key_version: "encryptionkey@0"
I20260808 17:50:38.394569 6283 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:50:38.395205 6315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:38.395350 6283 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:38.395433 6283 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "5eb0483a734342039cd6818b65d8e432"
format_stamp: "Formatted at 2026-08-08 17:50:38 on dist-test-slave-bndk"
server_key: "f218d978d0ecf8b10f363ac0c0b707b2"
server_key_iv: "4859b61d0efb8390bf2fe14803854a6e"
server_key_version: "encryptionkey@0"
I20260808 17:50:38.395496 6283 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:38.411968 6283 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:38.413964 6283 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:38.414093 6283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:38.417733 6283 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:38625
I20260808 17:50:38.417775 6397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:38625 every 8 connection(s)
I20260808 17:50:38.418084 6283 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:50:38.419023 6401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:38.421182 6401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432: Bootstrap starting.
I20260808 17:50:38.421347 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 6283
I20260808 17:50:38.421454 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:50:38.421624 29526 external_mini_cluster.cc:1428] Setting key d832f352fac6d29b251c10eaea9d2d98
I20260808 17:50:38.421830 6401 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:38.422143 6401 log.cc:824] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:38.422827 6401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432: No bootstrap required, opened a new log
I20260808 17:50:38.424952 6401 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } }
I20260808 17:50:38.425117 6401 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:38.425148 6401 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb0483a734342039cd6818b65d8e432, State: Initialized, Role: FOLLOWER
I20260808 17:50:38.425290 6401 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } }
I20260808 17:50:38.425386 6401 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:50:38.425422 6401 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:50:38.425467 6401 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:38.425992 6401 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } }
I20260808 17:50:38.426100 6401 leader_election.cc:302] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5eb0483a734342039cd6818b65d8e432; no voters:
I20260808 17:50:38.426259 6401 leader_election.cc:288] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:50:38.426298 6409 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:38.426456 6409 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [term 1 LEADER]: Becoming Leader. State: Replica: 5eb0483a734342039cd6818b65d8e432, State: Running, Role: LEADER
I20260808 17:50:38.426573 6401 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:38.426640 6409 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } }
I20260808 17:50:38.427124 6415 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5eb0483a734342039cd6818b65d8e432. Latest consensus state: current_term: 1 leader_uuid: "5eb0483a734342039cd6818b65d8e432" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } }
I20260808 17:50:38.427219 6415 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:38.427186 6414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5eb0483a734342039cd6818b65d8e432" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } }
I20260808 17:50:38.427582 6414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:38.427829 6421 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 08 17:50:38 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM
I20260808 17:50:38.428315 6421 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:50:38.430007 6421 catalog_manager.cc:1347] Generated new cluster ID: 4df93004cb3247bea06e50359efa3b7b
I20260808 17:50:38.430050 6421 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:50:38.432121 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:38.422062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39474 (local address 127.28.213.190:38625)
0808 17:50:38.422263 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:38.422272 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:38.422296 (+ 24us) server_negotiation.cc:407] Connection header received
0808 17:50:38.422790 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:38.422798 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:38.422846 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:38.422991 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:38.423688 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:38.424507 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:38.425566 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:38.425980 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:38.426060 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:38.428720 (+ 2660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:38.428724 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:38.428724 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:38.428735 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:38.430561 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:38.430926 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:38.430930 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:38.430930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:38.431036 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:38.431212 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:38.431213 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:38.431213 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:38.431534 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:38.431680 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:38.431775 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 17:50:38.431912 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":80,"threads_started":1}
I20260808 17:50:38.434214 6421 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:50:38.434878 6421 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:50:38.438174 6421 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432: Generated new TSK 0
I20260808 17:50:38.438323 6421 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.129.keytab.
Entry for principal oryx/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.129.keytab.
I20260808 17:50:38.471360 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38625
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.129.keytab
--principal=oryx/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:42503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:38.552789 6438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:38.552987 6438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:38.553009 6438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:38.554188 6438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:38.554231 6438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:38.554256 6438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:50:38.555706 6438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:42503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.129.keytab
--principal=oryx/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:38.555946 6438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:38.556166 6438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:38.560949 6448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:38.561054 6447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:38.561105 6438 server_base.cc:1034] running on GCE node
W20260808 17:50:38.560953 6450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:38.561395 6438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:38.561615 6438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:38.562762 6438 hybrid_clock.cc:648] HybridClock initialized: now 1786211438562745 us; error 31 us; skew 500 ppm
Aug 08 17:50:38 dist-test-slave-bndk krb5kdc[6263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211438, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:38.565167 6438 init.cc:377] Logged in from keytab as oryx/127.28.213.129@KRBTEST.COM (short username oryx)
I20260808 17:50:38.565594 6438 webserver.cc:460] Webserver started at http://127.28.213.129:43199/ using document root <none> and password file <none>
I20260808 17:50:38.565785 6438 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:38.565824 6438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:38.565933 6438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:38.566923 6438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "0435c861f1d04d16a2b5b1f07b049cde"
format_stamp: "Formatted at 2026-08-08 17:50:38 on dist-test-slave-bndk"
server_key: "e243c7f89a62ee170930532169e94653"
server_key_iv: "baec9a1cd6a16d8a1c6d92778202f03d"
server_key_version: "encryptionkey@0"
I20260808 17:50:38.567229 6438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "0435c861f1d04d16a2b5b1f07b049cde"
format_stamp: "Formatted at 2026-08-08 17:50:38 on dist-test-slave-bndk"
server_key: "e243c7f89a62ee170930532169e94653"
server_key_iv: "baec9a1cd6a16d8a1c6d92778202f03d"
server_key_version: "encryptionkey@0"
I20260808 17:50:38.568468 6438 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:50:38.569168 6461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:38.569386 6438 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:38.569473 6438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "0435c861f1d04d16a2b5b1f07b049cde"
format_stamp: "Formatted at 2026-08-08 17:50:38 on dist-test-slave-bndk"
server_key: "e243c7f89a62ee170930532169e94653"
server_key_iv: "baec9a1cd6a16d8a1c6d92778202f03d"
server_key_version: "encryptionkey@0"
I20260808 17:50:38.569527 6438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:38.588742 6438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:38.590730 6438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:38.590843 6438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:38.591015 6438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:38.591267 6438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:38.591321 6438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:38.591341 6438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:38.591352 6438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:38.596603 6438 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:33275
I20260808 17:50:38.596732 6630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:33275 every 8 connection(s)
I20260808 17:50:38.597000 6438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
Aug 08 17:50:38 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211438, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM
I20260808 17:50:38.606880 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 6438
I20260808 17:50:38.606997 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:50:38.607193 29526 external_mini_cluster.cc:1428] Setting key c869edd2b048c43d231a790b43c36c79
I20260808 17:50:38.608997 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:38.597833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:55121 (local address 127.28.213.190:38625)
0808 17:50:38.597896 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:38.597898 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:38.598084 (+ 186us) server_negotiation.cc:407] Connection header received
0808 17:50:38.598690 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:38.598692 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:38.598744 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:38.598864 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:38.599965 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:38.600725 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:38.602180 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:38.602525 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:38.602590 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:38.604722 (+ 2132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:38.604723 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:38.604724 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:38.604730 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:38.607505 (+ 2775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:38.607990 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:38.607992 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:38.607992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:38.608065 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:38.608385 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:38.608386 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:38.608387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:38.608502 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:38.608536 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:38.608818 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 17:50:38.608908 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 17:50:38.609138 6633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:38.597806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.129:55121)
0808 17:50:38.597964 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:38.598012 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:38.598588 (+ 576us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:38.598998 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:38.599003 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:38.599673 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:38.599863 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:38.599869 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:38.600847 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:38.600848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:38.602105 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:38.602109 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:38.602616 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:38.602618 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:38.602785 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:38.603298 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:38.603307 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:38.604634 (+ 1327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:38.607587 (+ 2953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:38.607594 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:38.607596 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:38.607889 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:38.608150 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:38.608151 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:38.608151 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:38.608286 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:38.608571 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:38.608577 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:38.608686 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 17:50:38.608768 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 17:50:38.608915 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":95,"threads_started":1}
I20260808 17:50:38.610073 6631 heartbeater.cc:347] Connected to a master server at 127.28.213.190:38625
I20260808 17:50:38.610174 6631 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:38.610355 6631 heartbeater.cc:511] Master 127.28.213.190:38625 requested a full tablet report, sending...
I20260808 17:50:38.610855 6345 ts_manager.cc:194] Registered new tserver with Master: 0435c861f1d04d16a2b5b1f07b049cde (127.28.213.129:33275)
I20260808 17:50:38.611464 6345 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:55121
WARNING: no policy specified for oryx/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.130.keytab.
Entry for principal oryx/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.130.keytab.
I20260808 17:50:38.631568 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38625
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.130.keytab
--principal=oryx/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:42503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:38.710920 6637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:38.711108 6637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:38.711138 6637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:38.712234 6637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:38.712272 6637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:38.712306 6637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:50:38.713753 6637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:42503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.130.keytab
--principal=oryx/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:38.713989 6637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:38.714190 6637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:38.718734 6643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:38.718752 6644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:38.718743 6646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:38.718983 6637 server_base.cc:1034] running on GCE node
I20260808 17:50:38.719156 6637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:38.719347 6637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:38.720476 6637 hybrid_clock.cc:648] HybridClock initialized: now 1786211438720464 us; error 29 us; skew 500 ppm
Aug 08 17:50:38 dist-test-slave-bndk krb5kdc[6263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211438, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:38.722844 6637 init.cc:377] Logged in from keytab as oryx/127.28.213.130@KRBTEST.COM (short username oryx)
I20260808 17:50:38.723233 6637 webserver.cc:460] Webserver started at http://127.28.213.130:34629/ using document root <none> and password file <none>
I20260808 17:50:38.723435 6637 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:38.723483 6637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:38.723608 6637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:38.724557 6637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "93741712302c47528a0c85bd02d5b377"
format_stamp: "Formatted at 2026-08-08 17:50:38 on dist-test-slave-bndk"
server_key: "0d06d238e024737385192c93d555074d"
server_key_iv: "05bcde22b6ce3598a01adf5c7cfa4224"
server_key_version: "encryptionkey@0"
I20260808 17:50:38.724874 6637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "93741712302c47528a0c85bd02d5b377"
format_stamp: "Formatted at 2026-08-08 17:50:38 on dist-test-slave-bndk"
server_key: "0d06d238e024737385192c93d555074d"
server_key_iv: "05bcde22b6ce3598a01adf5c7cfa4224"
server_key_version: "encryptionkey@0"
I20260808 17:50:38.726177 6637 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:50:38.726825 6656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:38.726979 6637 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:38.727062 6637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "93741712302c47528a0c85bd02d5b377"
format_stamp: "Formatted at 2026-08-08 17:50:38 on dist-test-slave-bndk"
server_key: "0d06d238e024737385192c93d555074d"
server_key_iv: "05bcde22b6ce3598a01adf5c7cfa4224"
server_key_version: "encryptionkey@0"
I20260808 17:50:38.727130 6637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:38.735086 6637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:38.737017 6637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:38.737140 6637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:38.737366 6637 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:38.737634 6637 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:38.737666 6637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:38.737685 6637 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:38.737708 6637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:38.742904 6637 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:42957
I20260808 17:50:38.742955 6846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:42957 every 8 connection(s)
I20260808 17:50:38.743199 6637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:50:38.745711 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 6637
I20260808 17:50:38.745814 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:50:38.746001 29526 external_mini_cluster.cc:1428] Setting key 272cf812ca0e5959af3306b9ff7f2d67
Aug 08 17:50:38 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211438, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM
I20260808 17:50:38.751662 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:38.743820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:52901 (local address 127.28.213.190:38625)
0808 17:50:38.743866 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:38.743868 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:38.744035 (+ 167us) server_negotiation.cc:407] Connection header received
0808 17:50:38.744483 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:38.744485 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:38.744498 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:38.744548 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:38.745455 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:38.746156 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:38.747096 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:38.747301 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:38.747357 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:38.749210 (+ 1853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:38.749212 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:38.749212 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:38.749238 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:38.750359 (+ 1121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:38.750737 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:38.750739 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:38.750740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:38.750812 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:38.751043 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:38.751044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:38.751045 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:38.751184 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:38.751257 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:38.751479 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 17:50:38.751570 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:50:38.751686 6849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:38.743790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.130:52901)
0808 17:50:38.743930 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:38.743963 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:38.744393 (+ 430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:38.744609 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:38.744614 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:38.745146 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:38.745365 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:38.745370 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:38.746236 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:38.746237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:38.747015 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:38.747017 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:38.747368 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:38.747369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:38.747485 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:38.747881 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:38.747888 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:38.749124 (+ 1236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:38.750438 (+ 1314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:38.750444 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:38.750446 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:38.750650 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:38.750882 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:38.750882 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:38.750882 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:38.750988 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:38.751242 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:38.751245 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:38.751354 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 17:50:38.751430 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 17:50:38.751542 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":67,"threads_started":1}
I20260808 17:50:38.752144 6847 heartbeater.cc:347] Connected to a master server at 127.28.213.190:38625
I20260808 17:50:38.752226 6847 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:38.752381 6847 heartbeater.cc:511] Master 127.28.213.190:38625 requested a full tablet report, sending...
I20260808 17:50:38.752740 6345 ts_manager.cc:194] Registered new tserver with Master: 93741712302c47528a0c85bd02d5b377 (127.28.213.130:42957)
I20260808 17:50:38.753249 6345 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:52901
WARNING: no policy specified for oryx/127.28.213.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.131.keytab.
Entry for principal oryx/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.131.keytab.
I20260808 17:50:38.769697 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38625
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.131.keytab
--principal=oryx/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:42503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:38.848080 6852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:38.848265 6852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:38.848295 6852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:38.849440 6852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:38.849483 6852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:38.849516 6852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:50:38.850919 6852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:42503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.131.keytab
--principal=oryx/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:38.851135 6852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:38.851353 6852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:38.855875 6858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:38.855877 6860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:38.855886 6863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:38.855947 6852 server_base.cc:1034] running on GCE node
I20260808 17:50:38.856297 6852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:38.856491 6852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:38.857615 6852 hybrid_clock.cc:648] HybridClock initialized: now 1786211438857603 us; error 29 us; skew 500 ppm
Aug 08 17:50:38 dist-test-slave-bndk krb5kdc[6263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211438, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:38.859897 6852 init.cc:377] Logged in from keytab as oryx/127.28.213.131@KRBTEST.COM (short username oryx)
I20260808 17:50:38.860283 6852 webserver.cc:460] Webserver started at http://127.28.213.131:34739/ using document root <none> and password file <none>
I20260808 17:50:38.860469 6852 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:38.860517 6852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:38.860634 6852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:38.861608 6852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "49cc6e8f7b8348a0ac937675ff758922"
format_stamp: "Formatted at 2026-08-08 17:50:38 on dist-test-slave-bndk"
server_key: "6449d5930846a79aff964fe632956d6f"
server_key_iv: "f1d08e5563bdb226d6eecb134ed0295c"
server_key_version: "encryptionkey@0"
I20260808 17:50:38.861924 6852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "49cc6e8f7b8348a0ac937675ff758922"
format_stamp: "Formatted at 2026-08-08 17:50:38 on dist-test-slave-bndk"
server_key: "6449d5930846a79aff964fe632956d6f"
server_key_iv: "f1d08e5563bdb226d6eecb134ed0295c"
server_key_version: "encryptionkey@0"
I20260808 17:50:38.863085 6852 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:50:38.863745 6872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:38.863888 6852 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:38.863976 6852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "49cc6e8f7b8348a0ac937675ff758922"
format_stamp: "Formatted at 2026-08-08 17:50:38 on dist-test-slave-bndk"
server_key: "6449d5930846a79aff964fe632956d6f"
server_key_iv: "f1d08e5563bdb226d6eecb134ed0295c"
server_key_version: "encryptionkey@0"
I20260808 17:50:38.864034 6852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:38.872756 6852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:38.874425 6852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:38.874550 6852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:38.874775 6852 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:38.875048 6852 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:38.875082 6852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:38.875108 6852 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:38.875133 6852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:38.880463 6852 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:33753
I20260808 17:50:38.880518 7055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:33753 every 8 connection(s)
I20260808 17:50:38.880777 6852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:50:38.883736 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 6852
I20260808 17:50:38.883841 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:50:38.884029 29526 external_mini_cluster.cc:1428] Setting key 4e63ffb9226c8db0d5bc65cc18bf4745
Aug 08 17:50:38 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211438, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM
I20260808 17:50:38.888913 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:38.881379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:32955 (local address 127.28.213.190:38625)
0808 17:50:38.881457 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:38.881460 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:38.881615 (+ 155us) server_negotiation.cc:407] Connection header received
0808 17:50:38.882039 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:38.882041 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:38.882050 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:38.882093 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:38.882907 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:38.883410 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:38.884569 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:38.884781 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:38.884837 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:38.886691 (+ 1854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:38.886692 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:38.886692 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:38.886700 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:38.887725 (+ 1025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:38.888076 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:38.888077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:38.888077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:38.888132 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:38.888335 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:38.888336 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:38.888336 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:38.888450 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:38.888506 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:38.888745 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 17:50:38.888826 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 17:50:38.889065 7060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:38.881359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.131:32955)
0808 17:50:38.881512 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:38.881546 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:38.881972 (+ 426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:38.882147 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:38.882149 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:38.882668 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:38.882840 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:38.882844 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:38.883471 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:38.883472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:38.884490 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:38.884493 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:38.884850 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:38.884850 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:38.884968 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:38.885368 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:38.885375 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:38.886606 (+ 1231us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:38.887798 (+ 1192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:38.887805 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:38.887807 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:38.888011 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:38.888185 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:38.888186 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:38.888187 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:38.888280 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:38.888505 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:38.888511 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:38.888633 (+ 122us) client_negotiation.cc:769] Sending connection context
0808 17:50:38.888714 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 17:50:38.888855 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":81,"threads_started":1}
I20260808 17:50:38.889472 7057 heartbeater.cc:347] Connected to a master server at 127.28.213.190:38625
I20260808 17:50:38.889562 7057 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:38.889721 7057 heartbeater.cc:511] Master 127.28.213.190:38625 requested a full tablet report, sending...
I20260808 17:50:38.890027 6345 ts_manager.cc:194] Registered new tserver with Master: 49cc6e8f7b8348a0ac937675ff758922 (127.28.213.131:33753)
I20260808 17:50:38.890352 6345 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:32955
I20260808 17:50:38.895583 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.28.213.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.213.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.213.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.189.keytab.
Entry for principal oryx/127.28.213.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.189.keytab.
I20260808 17:50:38.919339 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.189:43731
--webserver_interface=127.28.213.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.189.keytab
--principal=oryx/127.28.213.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:42503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:38625,127.28.213.189:43731
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:38.998904 7066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:38.999083 7066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:38.999104 7066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:39.000161 7066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:39.000195 7066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:39.000207 7066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:39.000218 7066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:39.000234 7066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:50:39.001672 7066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:42503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:38625,127.28.213.189:43731
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.189.keytab
--principal=oryx/127.28.213.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.189:43731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.28.213.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
W20260808 17:50:39.001776 7066 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.28.213.190:38625,127.28.213.189:43731'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 17:50:39.001875 7066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:39.002032 7066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:39.006374 7076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:39.006397 7074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:39.006397 7079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:39.006457 7066 server_base.cc:1034] running on GCE node
I20260808 17:50:39.006758 7066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:39.007037 7066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:39.008175 7066 hybrid_clock.cc:648] HybridClock initialized: now 1786211439008153 us; error 33 us; skew 500 ppm
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:39.010527 7066 init.cc:377] Logged in from keytab as oryx/127.28.213.189@KRBTEST.COM (short username oryx)
I20260808 17:50:39.010922 7066 webserver.cc:460] Webserver started at http://127.28.213.189:42791/ using document root <none> and password file <none>
I20260808 17:50:39.011132 7066 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:39.011175 7066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:39.011307 7066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:39.012264 7066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/data/instance:
uuid: "7ac94f985d6340e983380a2ed849913f"
format_stamp: "Formatted at 2026-08-08 17:50:39 on dist-test-slave-bndk"
server_key: "58e607169888f932e0e64223113ee477"
server_key_iv: "c85e636649ffd06915b20357d8aa856f"
server_key_version: "encryptionkey@0"
I20260808 17:50:39.012573 7066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/wal/instance:
uuid: "7ac94f985d6340e983380a2ed849913f"
format_stamp: "Formatted at 2026-08-08 17:50:39 on dist-test-slave-bndk"
server_key: "58e607169888f932e0e64223113ee477"
server_key_iv: "c85e636649ffd06915b20357d8aa856f"
server_key_version: "encryptionkey@0"
I20260808 17:50:39.013823 7066 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 17:50:39.014446 7092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.014586 7066 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.014668 7066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/wal
uuid: "7ac94f985d6340e983380a2ed849913f"
format_stamp: "Formatted at 2026-08-08 17:50:39 on dist-test-slave-bndk"
server_key: "58e607169888f932e0e64223113ee477"
server_key_iv: "c85e636649ffd06915b20357d8aa856f"
server_key_version: "encryptionkey@0"
I20260808 17:50:39.014730 7066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:39.041533 7066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:39.043491 7066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:39.043622 7066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:39.047230 7066 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.189:43731
I20260808 17:50:39.047263 7174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.189:43731 every 8 connection(s)
I20260808 17:50:39.047564 7066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/data/info.pb
I20260808 17:50:39.048538 7175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:39.050009 7175 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:50:39.053748 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 7066
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.189@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM
I20260808 17:50:39.058492 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.050621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39484 (local address 127.28.213.190:38625)
0808 17:50:39.050673 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.050674 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.050868 (+ 194us) server_negotiation.cc:407] Connection header received
0808 17:50:39.051307 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.051308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.051320 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.051370 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.051911 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.052381 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.053320 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.053516 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.053562 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.055694 (+ 2132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.055696 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.055696 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.055704 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.057131 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.057555 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.057556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.057557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.057617 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.057843 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.057844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.057845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.057996 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.058056 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.058293 (+ 237us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.058387 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 17:50:39.058594 7179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.050589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.0.0.1:39484)
0808 17:50:39.050751 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.050786 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.051220 (+ 434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.051429 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.051432 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.051658 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.051843 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.051847 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.052437 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.052438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.053206 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.053208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.053572 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.053573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.053670 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.054115 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.054124 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.055613 (+ 1489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.057195 (+ 1582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.057199 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.057201 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.057499 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.057680 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.057680 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.057681 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.057774 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.058060 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.058066 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.058175 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.058260 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.058395 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":95,"threads_started":1}
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.213.189@KRBTEST.COM
I20260808 17:50:39.059422 7175 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.189@KRBTEST.COM for oryx/127.28.213.189@KRBTEST.COM
I20260808 17:50:39.063455 7183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.054282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57764 (local address 127.28.213.189:43731)
0808 17:50:39.054523 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.054527 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.054541 (+ 14us) server_negotiation.cc:407] Connection header received
0808 17:50:39.054557 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.054558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.054574 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.054624 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.055194 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.056088 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.057067 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.057480 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.057554 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.059859 (+ 2305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.059864 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.059865 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.059870 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.062395 (+ 2525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.062709 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.062712 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.062712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.062770 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.062972 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.062973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.062973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.063089 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.063195 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.063287 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.063358 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":69,"threads_started":1}
I20260808 17:50:39.066249 7179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.059629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:43731 (local address 127.0.0.1:57780)
0808 17:50:39.059669 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.059678 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.059716 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.059927 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.059928 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.060068 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.060120 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.060121 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.060939 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.060940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.061666 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.061669 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.062033 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.062034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.062104 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.062375 (+ 271us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.062379 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.063690 (+ 1311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.065415 (+ 1725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.065415 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.065416 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.065566 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.065726 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.065727 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.065727 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.065778 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.065971 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.065972 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.066006 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.066065 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.066152 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260808 17:50:39.066330 7184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.059659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57780 (local address 127.28.213.189:43731)
0808 17:50:39.059817 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.059819 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.059826 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:50:39.059845 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.059846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.059855 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.059912 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.060195 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.060863 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.061753 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.061968 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.062013 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.063758 (+ 1745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.063759 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.063759 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.063765 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.065353 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.065622 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.065623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.065623 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.065674 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.065825 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.065825 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.065825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.065920 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.065972 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.066090 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.066202 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":138,"thread_start_us":101,"threads_started":1}
I20260808 17:50:39.067456 7175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: Bootstrap starting.
I20260808 17:50:39.068013 7175 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:39.068249 7175 log.cc:824] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:39.068878 7175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: No bootstrap required, opened a new log
I20260808 17:50:39.070180 7175 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } }
I20260808 17:50:39.070292 7175 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:39.070324 7175 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac94f985d6340e983380a2ed849913f, State: Initialized, Role: FOLLOWER
I20260808 17:50:39.070442 7175 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } }
I20260808 17:50:39.070648 7186 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } } }
I20260808 17:50:39.070712 7175 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:39.070736 7186 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [sys.catalog]: This master's current role is: FOLLOWER
W20260808 17:50:39.072196 7210 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:50:39.072249 7210 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:50:39.073841 7066 master_runner.cc:428] Detected that this master 7ac94f985d6340e983380a2ed849913f is joining an existing cluster
I20260808 17:50:39.073915 7066 master_runner.cc:432] Initiating AddMaster RPC to add 127.28.213.189:43731
I20260808 17:50:39.080415 7222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.074691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:43731 (local address 127.0.0.1:57784)
0808 17:50:39.074888 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.074895 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.074951 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.075072 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.075072 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.075275 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.075363 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.075365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.076210 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.076210 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.076737 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.076739 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.077072 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.077073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.077126 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.077488 (+ 362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.077493 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.077746 (+ 253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.079437 (+ 1691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.079438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.079438 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.079606 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.079784 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.079784 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.079785 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.079841 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.080067 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.080067 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.080117 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.080195 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.080298 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":2,"thread_start_us":86,"threads_started":1}
I20260808 17:50:39.080477 7184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.074721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57784 (local address 127.28.213.189:43731)
0808 17:50:39.074850 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.074852 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.074934 (+ 82us) server_negotiation.cc:407] Connection header received
0808 17:50:39.074994 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.074995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.075003 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.075043 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.075442 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.076141 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.076807 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.077003 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.077054 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.077819 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.077820 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.077821 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.077827 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.079369 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.079665 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.079666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.079666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.079721 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.079901 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.079902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.079902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.080012 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.080066 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.080259 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.080360 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":115}
I20260808 17:50:39.081924 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.074881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39492 (local address 127.28.213.190:38625)
0808 17:50:39.074929 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.074930 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.074956 (+ 26us) server_negotiation.cc:407] Connection header received
0808 17:50:39.074976 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.074977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.074986 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.075043 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.076244 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.076976 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.078059 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.078310 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.078362 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.079358 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.079359 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.079360 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.079366 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.080925 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.081233 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.081234 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.081235 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.081291 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.081462 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.081463 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.081463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.081564 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.081619 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.081765 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.081829 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 17:50:39.081933 7221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.074676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.0.0.1:39492)
0808 17:50:39.074840 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.074849 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.074900 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.075048 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.075049 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.075278 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.075363 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.075365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.077077 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.077078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.077936 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.077939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.078378 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.078379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.078465 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.078786 (+ 321us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.078790 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.079255 (+ 465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.080997 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.080997 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.080998 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.081145 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.081348 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.081349 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.081349 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.081412 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.081618 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.081619 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.081669 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.081736 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.081829 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":14,"thread_start_us":102,"threads_started":1}
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211438, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.190@KRBTEST.COM for oryx/127.28.213.189@KRBTEST.COM
I20260808 17:50:39.090561 7224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.084015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:43731 (local address 127.0.0.1:57790)
0808 17:50:39.084139 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.084177 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.084239 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.084361 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.084363 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.084583 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.084626 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.084628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.085487 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.085488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.086028 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.086030 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.086437 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.086437 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.086481 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.086835 (+ 354us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.086839 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.088176 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.089635 (+ 1459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.089642 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.089643 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.089821 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.090002 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.090002 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.090003 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.090051 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.090301 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.090305 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.090343 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.090398 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.090489 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":69,"threads_started":1}
I20260808 17:50:39.090593 7184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.084086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57790 (local address 127.28.213.189:43731)
0808 17:50:39.084123 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.084125 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.084235 (+ 110us) server_negotiation.cc:407] Connection header received
0808 17:50:39.084289 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.084290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.084298 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.084357 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.084687 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.085424 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.086093 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.086379 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.086439 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.088263 (+ 1824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.088265 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.088265 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.088271 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.089565 (+ 1294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.089884 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.089885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.089885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.089947 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.090101 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.090102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.090102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.090247 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.090312 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.090436 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.090509 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:50:39.091100 6345 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.28.213.189:43731: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "7ac94f985d6340e983380a2ed849913f"
member_type: NON_VOTER
last_known_addr {
host: "127.28.213.189"
port: 43731
}
attrs {
promote: true
}
}
dest_uuid: "5eb0483a734342039cd6818b65d8e432"
cas_config_opid_index: -1
I20260808 17:50:39.091426 6345 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } }
I20260808 17:50:39.091850 7227 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 7ac94f985d6340e983380a2ed849913f (127.28.213.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } } }
I20260808 17:50:39.092159 7133 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:39.092666 7227 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.28.213.189:43731
I20260808 17:50:39.092962 7066 master.cc:537] Master@127.28.213.189:43731 shutting down...
I20260808 17:50:39.093010 7133 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 1 FOLLOWER]: Refusing update from remote peer 5eb0483a734342039cd6818b65d8e432: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 17:50:39.092957 7226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5eb0483a734342039cd6818b65d8e432" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } } }
I20260808 17:50:39.093362 7227 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:39.093503 7226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: This master's current role is: LEADER
W20260808 17:50:39.094094 6320 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 17:50:39.094476 6320 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 -> Peer 7ac94f985d6340e983380a2ed849913f (127.28.213.189:43731): Couldn't send request to peer 7ac94f985d6340e983380a2ed849913f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 17:50:39.095770 7066 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:39.095856 7066 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:39.095909 7066 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: stopping tablet replica
I20260808 17:50:39.108807 7066 master.cc:552] Master@127.28.213.189:43731 shutdown complete.
I20260808 17:50:39.108847 7066 master_runner.cc:305] Clearing existing system tablet
I20260808 17:50:39.108961 7066 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:39.109002 7066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:39.109650 7066 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.002s
I20260808 17:50:39.110366 7235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.110505 7066 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:39.110577 7066 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 17:50:39.110603 7066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/wal
uuid: "7ac94f985d6340e983380a2ed849913f"
format_stamp: "Formatted at 2026-08-08 17:50:39 on dist-test-slave-bndk"
server_key: "58e607169888f932e0e64223113ee477"
server_key_iv: "c85e636649ffd06915b20357d8aa856f"
server_key_version: "encryptionkey@0"
I20260808 17:50:39.111518 7066 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:39.113008 7066 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 17:50:39.113080 7066 log.cc:1196] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 17:50:39.113312 7066 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: Deleting consensus metadata
I20260808 17:50:39.113430 7066 master_runner.cc:315] Copying system tablet from 127.28.213.190:38625
I20260808 17:50:39.114027 7066 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: tablet copy: Beginning tablet copy session from remote peer at address 127.28.213.190:38625
I20260808 17:50:39.119510 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.114370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39498 (local address 127.28.213.190:38625)
0808 17:50:39.114412 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.114414 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.114515 (+ 101us) server_negotiation.cc:407] Connection header received
0808 17:50:39.114583 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.114584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.114596 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.114642 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.114952 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.115439 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.116111 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.116296 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.116348 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.117212 (+ 864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.117242 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.117242 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.117250 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.118515 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.118816 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.118817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.118818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.118873 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.119042 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.119042 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.119043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.119150 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.119208 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.119343 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.119419 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:50:39.119521 7245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.114306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.0.0.1:39498)
0808 17:50:39.114443 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.114452 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.114524 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.114644 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.114646 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.114825 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.114877 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.114879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.115510 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.115511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.116040 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.116042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.116352 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.116353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.116418 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.116827 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.116833 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.117127 (+ 294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.118590 (+ 1463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.118591 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.118592 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.118755 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.118934 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.118935 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.118935 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.118991 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.119204 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.119205 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.119251 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.119310 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.119412 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":69,"threads_started":1}
I20260808 17:50:39.119942 6373 tablet_copy_service.cc:140] P 5eb0483a734342039cd6818b65d8e432: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 7ac94f985d6340e983380a2ed849913f ({username='oryx', principal='oryx/127.28.213.189@KRBTEST.COM'} at 127.0.0.1:39498)
I20260808 17:50:39.120060 6373 tablet_copy_service.cc:161] P 5eb0483a734342039cd6818b65d8e432: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 7ac94f985d6340e983380a2ed849913f at {username='oryx', principal='oryx/127.28.213.189@KRBTEST.COM'} at 127.0.0.1:39498: session id = 7ac94f985d6340e983380a2ed849913f-00000000000000000000000000000000
I20260808 17:50:39.120772 6373 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 17:50:39.121395 7066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 17:50:39.122663 7066 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: tablet copy: Starting download of 0 data blocks...
I20260808 17:50:39.122813 7066 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: tablet copy: Starting download of 1 WAL segments...
I20260808 17:50:39.123718 7066 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 17:50:39.124586 6373 tablet_copy_service.cc:342] P 5eb0483a734342039cd6818b65d8e432: Request end of tablet copy session 7ac94f985d6340e983380a2ed849913f-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.28.213.189@KRBTEST.COM'} at 127.0.0.1:39498
I20260808 17:50:39.124634 6373 tablet_copy_service.cc:433] P 5eb0483a734342039cd6818b65d8e432: ending tablet copy session 7ac94f985d6340e983380a2ed849913f-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 7ac94f985d6340e983380a2ed849913f
I20260808 17:50:39.127131 7066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:39.128118 7248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:39.128244 7251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:39.128382 7066 server_base.cc:1034] running on GCE node
W20260808 17:50:39.129343 7247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:39.129491 7066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:39.129630 7066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:39.130738 7066 hybrid_clock.cc:648] HybridClock initialized: now 1786211439130732 us; error 23 us; skew 500 ppm
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:39.132078 7066 init.cc:377] Logged in from keytab as oryx/127.28.213.189@KRBTEST.COM (short username oryx)
I20260808 17:50:39.132324 7066 webserver.cc:460] Webserver started at http://127.28.213.189:45149/ using document root <none> and password file <none>
I20260808 17:50:39.132431 7066 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:39.132464 7066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:39.133101 7066 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:39.133634 7264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.133752 7066 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.133808 7066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/wal
uuid: "7ac94f985d6340e983380a2ed849913f"
format_stamp: "Formatted at 2026-08-08 17:50:39 on dist-test-slave-bndk"
server_key: "58e607169888f932e0e64223113ee477"
server_key_iv: "c85e636649ffd06915b20357d8aa856f"
server_key_version: "encryptionkey@0"
I20260808 17:50:39.133862 7066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:39.143222 7066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:39.144591 7066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:39.147873 7066 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.189:43731
I20260808 17:50:39.148080 7353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.189:43731 every 8 connection(s)
I20260808 17:50:39.148253 7066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-1/data/info.pb
I20260808 17:50:39.148973 7354 sys_catalog.cc:263] Verifying existing consensus state
I20260808 17:50:39.149442 7354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: Bootstrap starting.
I20260808 17:50:39.151958 7354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:50:39.152155 7354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: Bootstrap complete.
I20260808 17:50:39.152333 7354 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } }
I20260808 17:50:39.152398 7354 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ac94f985d6340e983380a2ed849913f, State: Initialized, Role: LEARNER
I20260808 17:50:39.152442 7354 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } }
I20260808 17:50:39.152598 7354 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:39.152592 7359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } } }
I20260808 17:50:39.152707 7359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [sys.catalog]: This master's current role is: LEARNER
I20260808 17:50:39.153955 7371 catalog_manager.cc:1259] Loaded cluster ID: 4df93004cb3247bea06e50359efa3b7b
I20260808 17:50:39.153998 7371 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: loading cluster ID for follower catalog manager: success
I20260808 17:50:39.154897 7371 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: acquiring CA information for follower catalog manager: success
I20260808 17:50:39.155248 7371 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 17:50:39.173460 7374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.164905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57804 (local address 127.28.213.189:43731)
0808 17:50:39.166830 (+ 1925us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.166832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.166843 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:50:39.166868 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.166869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.166880 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.166961 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.167504 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.168551 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.169279 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.169587 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.169666 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.170744 (+ 1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.170746 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.170747 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.170754 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.172305 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.172629 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.172631 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.172631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.172701 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.172864 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.172865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.172866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.172994 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.173126 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.173262 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.173349 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1894,"thread_start_us":1866,"threads_started":1}
WARNING: no policy specified for oryx/127.28.213.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.213.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.213.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.188.keytab.
Entry for principal oryx/127.28.213.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.188.keytab.
I20260808 17:50:39.199470 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.188:33513
--webserver_interface=127.28.213.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.188.keytab
--principal=oryx/127.28.213.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:42503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:38625,127.28.213.189:43731,127.28.213.188:33513
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:39.285828 7379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:39.286015 7379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:39.286034 7379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:39.287158 7379 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:39.287199 7379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:39.287211 7379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:39.287233 7379 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:39.287258 7379 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:50:39.288710 7379 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:42503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:38625,127.28.213.189:43731,127.28.213.188:33513
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.188.keytab
--principal=oryx/127.28.213.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.188:33513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.28.213.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7379
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:39.288925 7379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:39.289126 7379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:39.293531 7385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:39.293550 7387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:39.293648 7379 server_base.cc:1034] running on GCE node
W20260808 17:50:39.293531 7390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:39.293987 7379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:39.294270 7379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:39.295403 7379 hybrid_clock.cc:648] HybridClock initialized: now 1786211439295384 us; error 33 us; skew 500 ppm
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:39.297801 7379 init.cc:377] Logged in from keytab as oryx/127.28.213.188@KRBTEST.COM (short username oryx)
I20260808 17:50:39.298205 7379 webserver.cc:460] Webserver started at http://127.28.213.188:34651/ using document root <none> and password file <none>
I20260808 17:50:39.298377 7379 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:39.298416 7379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:39.298508 7379 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:39.299466 7379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/data/instance:
uuid: "367f2cd7cc7a4e6cab215ab04f5370c8"
format_stamp: "Formatted at 2026-08-08 17:50:39 on dist-test-slave-bndk"
server_key: "ca11e161eabf83e6292cfe23b04ef792"
server_key_iv: "ceacd27b29cd5cea9b0f6febd00a0fbc"
server_key_version: "encryptionkey@0"
I20260808 17:50:39.299757 7379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/wal/instance:
uuid: "367f2cd7cc7a4e6cab215ab04f5370c8"
format_stamp: "Formatted at 2026-08-08 17:50:39 on dist-test-slave-bndk"
server_key: "ca11e161eabf83e6292cfe23b04ef792"
server_key_iv: "ceacd27b29cd5cea9b0f6febd00a0fbc"
server_key_version: "encryptionkey@0"
I20260808 17:50:39.300905 7379 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:50:39.301513 7401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.301678 7379 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.301762 7379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/wal
uuid: "367f2cd7cc7a4e6cab215ab04f5370c8"
format_stamp: "Formatted at 2026-08-08 17:50:39 on dist-test-slave-bndk"
server_key: "ca11e161eabf83e6292cfe23b04ef792"
server_key_iv: "ceacd27b29cd5cea9b0f6febd00a0fbc"
server_key_version: "encryptionkey@0"
I20260808 17:50:39.301816 7379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:39.326984 7379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:39.329100 7379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:39.329207 7379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:39.333202 7379 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.188:33513
I20260808 17:50:39.333314 7483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.188:33513 every 8 connection(s)
I20260808 17:50:39.333634 7379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/data/info.pb
I20260808 17:50:39.334268 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 7379
I20260808 17:50:39.334744 7484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:39.336930 7484 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.213.188@KRBTEST.COM
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.188@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM
I20260808 17:50:39.344833 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.337795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39508 (local address 127.28.213.190:38625)
0808 17:50:39.337835 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.337836 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.337873 (+ 37us) server_negotiation.cc:407] Connection header received
0808 17:50:39.337947 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.337948 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.337959 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.338004 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.338431 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.338998 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.339959 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.340246 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.340312 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.342493 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.342495 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.342495 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.342501 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.343756 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.344141 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.344141 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.344142 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.344195 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.344359 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.344360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.344360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.344450 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.344498 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.344678 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.344748 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:50:39.344998 7489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.335061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37888 (local address 127.28.213.188:33513)
0808 17:50:39.335241 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.335249 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.335273 (+ 24us) server_negotiation.cc:407] Connection header received
0808 17:50:39.335734 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.335740 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.335787 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.335896 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.336610 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.337683 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.338619 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.339205 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.339306 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.341864 (+ 2558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.341872 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.341873 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.341880 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.343578 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.343922 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.343925 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.343925 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.344006 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.344175 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.344176 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.344176 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.344454 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.344572 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.344654 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.344788 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":76,"threads_started":1}
I20260808 17:50:39.345009 7490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.337577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.0.0.1:39508)
0808 17:50:39.337787 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.337825 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.337890 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.338022 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.338025 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.338267 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.338352 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.338354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.339086 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.339087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.339865 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.339869 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.340354 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.340355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.340429 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.340864 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.340874 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.342411 (+ 1537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.343834 (+ 1423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.343840 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.343841 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.344080 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.344248 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.344248 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.344249 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.344303 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.344500 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.344506 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.344564 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.344654 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.344929 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":151,"thread_start_us":76,"threads_started":1}
I20260808 17:50:39.345538 7484 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.188@KRBTEST.COM for oryx/127.28.213.189@KRBTEST.COM
I20260808 17:50:39.350652 7490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.345761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:43731 (local address 127.0.0.1:57810)
0808 17:50:39.345793 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.345804 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.345845 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.345962 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.345962 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.346065 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.346105 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.346106 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.346645 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.346645 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.347104 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.347105 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.347396 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.347397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.347448 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.347703 (+ 255us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.347707 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.348743 (+ 1036us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.349973 (+ 1230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.349973 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.349974 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.350123 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.350262 (+ 139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.350262 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.350262 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.350305 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.350466 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.350466 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.350495 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.350538 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.350598 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260808 17:50:39.350685 7374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.345834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57810 (local address 127.28.213.189:43731)
0808 17:50:39.345875 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.345877 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.345883 (+ 6us) server_negotiation.cc:407] Connection header received
0808 17:50:39.345904 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.345905 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.345916 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.345953 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.346144 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.346595 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.347155 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.347334 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.347375 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.348820 (+ 1445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.348821 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.348822 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.348828 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.349901 (+ 1073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.350177 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.350177 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.350178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.350221 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.350337 (+ 116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.350337 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.350337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.350424 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.350470 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.350561 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.350617 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:50:39.351011 7484 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.188@KRBTEST.COM for oryx/127.28.213.188@KRBTEST.COM
I20260808 17:50:39.356235 7490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.351205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:33513 (local address 127.0.0.1:37892)
0808 17:50:39.351248 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.351258 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.351308 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.351423 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.351424 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.351536 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.351557 (+ 21us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.351558 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.352105 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.352106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.352649 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.352651 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.353035 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.353036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.353082 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.353455 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.353460 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.354464 (+ 1004us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.355573 (+ 1109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.355574 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.355574 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.355717 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.355849 (+ 132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.355849 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.355850 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.355890 (+ 40us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.356044 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.356045 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.356073 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.356114 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.356179 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 17:50:39.356300 7489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.351248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37892 (local address 127.28.213.188:33513)
0808 17:50:39.351288 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.351290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.351297 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:50:39.351349 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.351350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.351357 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.351397 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.351613 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.352042 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.352714 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.352980 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.353034 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.354533 (+ 1499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.354534 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.354535 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.354541 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.355512 (+ 971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.355768 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.355769 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.355769 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.355808 (+ 39us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.355929 (+ 121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.355929 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.355929 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.356006 (+ 77us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.356047 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.356130 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.356219 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":17}
I20260808 17:50:39.357456 7484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: Bootstrap starting.
I20260808 17:50:39.358232 7484 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:39.358480 7484 log.cc:824] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:39.359105 7484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: No bootstrap required, opened a new log
I20260808 17:50:39.360396 7484 raft_consensus.cc:348] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } }
I20260808 17:50:39.360512 7484 raft_consensus.cc:374] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:39.360544 7484 raft_consensus.cc:729] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367f2cd7cc7a4e6cab215ab04f5370c8, State: Initialized, Role: FOLLOWER
I20260808 17:50:39.360657 7484 consensus_queue.cc:260] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } }
I20260808 17:50:39.360932 7484 sys_catalog.cc:564] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:39.360898 7495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } } }
I20260808 17:50:39.360985 7495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 17:50:39.362562 7517 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:50:39.362617 7517 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:50:39.364591 7379 master_runner.cc:428] Detected that this master 367f2cd7cc7a4e6cab215ab04f5370c8 is joining an existing cluster
I20260808 17:50:39.364639 7379 master_runner.cc:432] Initiating AddMaster RPC to add 127.28.213.188:33513
I20260808 17:50:39.372815 7374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.365919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57816 (local address 127.28.213.189:43731)
0808 17:50:39.365955 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.365957 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.366006 (+ 49us) server_negotiation.cc:407] Connection header received
0808 17:50:39.366143 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.366144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.366156 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.366223 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.366620 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.367346 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.368488 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.368778 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.368817 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.369992 (+ 1175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.369994 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.369994 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.370000 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.371202 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.372035 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.372035 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.372036 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.372086 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.372262 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.372263 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.372263 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.372354 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.372413 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.372688 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.372754 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:50:39.372870 7526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.365765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:43731 (local address 127.0.0.1:57816)
0808 17:50:39.365937 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.365949 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.366032 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.366230 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.366231 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.366416 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.366490 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.366492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.367466 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.367467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.368377 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.368380 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.368905 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.368906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.368967 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.369474 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.369479 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.369902 (+ 423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.371289 (+ 1387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.371290 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.371290 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.371965 (+ 675us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.372141 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.372142 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.372143 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.372211 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.372439 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.372440 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.372580 (+ 140us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.372665 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.372763 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":80,"threads_started":1}
I20260808 17:50:39.384682 7530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.366607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:33513 (local address 127.0.0.1:37896)
0808 17:50:39.366765 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.366774 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.366838 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.366986 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.366987 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.367154 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.367249 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.367252 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.368039 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.368040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.368803 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.368804 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.369203 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.369203 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.369275 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.381637 (+ 12362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.381642 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.382102 (+ 460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.383574 (+ 1472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.383575 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.383576 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.383729 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.383899 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.383899 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.383900 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.383948 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.384340 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.384341 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.384384 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.384448 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.384550 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":108,"threads_started":1}
I20260808 17:50:39.384897 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.366044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39522 (local address 127.28.213.190:38625)
0808 17:50:39.366079 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.366081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.366356 (+ 275us) server_negotiation.cc:407] Connection header received
0808 17:50:39.366412 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.366413 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.366423 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.366470 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.366917 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.367626 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.368619 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.368893 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.368928 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.382244 (+ 13316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.382245 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.382246 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.382253 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.383777 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.384108 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.384109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.384110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.384165 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.384331 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.384331 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.384332 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.384468 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.384526 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.384732 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.384818 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:50:39.384752 7489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.366541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37896 (local address 127.28.213.188:33513)
0808 17:50:39.366571 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.366572 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.366822 (+ 250us) server_negotiation.cc:407] Connection header received
0808 17:50:39.366896 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.366911 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.366919 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.366944 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.367321 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.367953 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.368871 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.369121 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.369156 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.382202 (+ 13046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.382203 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.382203 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.382210 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.383503 (+ 1293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.383786 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.383787 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.383788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.383838 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.384015 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.384016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.384017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.384152 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.384223 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.384481 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.384613 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":16}
I20260808 17:50:39.385207 7527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.366020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.0.0.1:39522)
0808 17:50:39.366292 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.366301 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.366349 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.366547 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.366548 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.366777 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.366836 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.366838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.367709 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.367710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.368535 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.368536 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.368995 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.368996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.369057 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.381766 (+ 12709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.381771 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.382174 (+ 403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.383852 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.383853 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.383853 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.384040 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.384227 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.384228 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.384228 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.384283 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.384553 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.384554 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.384603 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.385013 (+ 410us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.385118 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":203,"threads_started":1}
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211438, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.190@KRBTEST.COM for oryx/127.28.213.188@KRBTEST.COM
I20260808 17:50:39.393119 7489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.387289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37898 (local address 127.28.213.188:33513)
0808 17:50:39.387341 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.387343 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.387349 (+ 6us) server_negotiation.cc:407] Connection header received
0808 17:50:39.387375 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.387376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.387383 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.387426 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.387737 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.388164 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.389109 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.389333 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.389388 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.390978 (+ 1590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.390979 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.390979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.390986 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.392157 (+ 1171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.392455 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.392456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.392457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.392510 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.392668 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.392669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.392669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.392763 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.392815 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.392968 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.393036 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 17:50:39.393133 7224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.387099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:33513 (local address 127.0.0.1:37898)
0808 17:50:39.387161 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.387173 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.387217 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.387449 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.387450 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.387610 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.387654 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.387655 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.388230 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.388231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.389042 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.389045 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.389405 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.389407 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.389481 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.389801 (+ 320us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.389806 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.390903 (+ 1097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.392230 (+ 1327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.392231 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.392232 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.392388 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.392562 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.392562 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.392562 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.392619 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.392815 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.392816 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.392879 (+ 63us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.392936 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.393038 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 17:50:39.393613 6345 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.28.213.188:33513: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8"
member_type: NON_VOTER
last_known_addr {
host: "127.28.213.188"
port: 33513
}
attrs {
promote: true
}
}
dest_uuid: "5eb0483a734342039cd6818b65d8e432"
cas_config_opid_index: 5
I20260808 17:50:39.393841 6345 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true } }
I20260808 17:50:39.394183 7226 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 367f2cd7cc7a4e6cab215ab04f5370c8 (127.28.213.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true } } }
I20260808 17:50:39.394380 7444 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:39.395212 7226 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.28.213.188:33513
I20260808 17:50:39.395242 7444 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 1 FOLLOWER]: Refusing update from remote peer 5eb0483a734342039cd6818b65d8e432: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 17:50:39.395289 7226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5eb0483a734342039cd6818b65d8e432" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true } } }
I20260808 17:50:39.395358 7226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:39.395692 7227 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [LEADER]: Connected to new peer: Peer: permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:39.396075 7379 master.cc:537] Master@127.28.213.188:33513 shutting down...
I20260808 17:50:39.399147 7374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.395586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57824 (local address 127.28.213.189:43731)
0808 17:50:39.395622 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.395624 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.395632 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:39.395681 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.395682 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.395703 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.395758 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:39.395877 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.396489 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.397918 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.398506 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.398564 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.398645 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.399007 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.399090 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:50:39.399390 7224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.395529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:43731 (local address 127.0.0.1:57824)
0808 17:50:39.395581 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.395592 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.395632 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.395771 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.395772 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.395773 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:39.395809 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.395811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.396566 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.396567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.397830 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.397833 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.398692 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.398693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.398756 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.398780 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.398830 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.398868 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 17:50:39.399595 7444 raft_consensus.cc:858] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true } }
W20260808 17:50:39.399672 7444 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true } }
I20260808 17:50:39.399762 7307 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 1 LEARNER]: Refusing update from remote peer 5eb0483a734342039cd6818b65d8e432: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 17:50:39.399991 7227 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 17:50:39.400297 7444 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 7ac94f985d6340e983380a2ed849913f (127.28.213.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } } }
I20260808 17:50:39.400499 7307 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 367f2cd7cc7a4e6cab215ab04f5370c8 (127.28.213.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true } } }
I20260808 17:50:39.401816 7359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5eb0483a734342039cd6818b65d8e432. Latest consensus state: current_term: 1 leader_uuid: "5eb0483a734342039cd6818b65d8e432" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true } } }
I20260808 17:50:39.401898 7359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [sys.catalog]: This master's current role is: LEARNER
I20260808 17:50:39.401849 7495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5eb0483a734342039cd6818b65d8e432. Latest consensus state: current_term: 1 leader_uuid: "5eb0483a734342039cd6818b65d8e432" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } } }
I20260808 17:50:39.401926 7495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 17:50:39.401932 7359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5eb0483a734342039cd6818b65d8e432" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true } } }
I20260808 17:50:39.401974 7359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [sys.catalog]: This master's current role is: LEARNER
I20260808 17:50:39.401966 7495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5eb0483a734342039cd6818b65d8e432" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } } }
I20260808 17:50:39.402019 7495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 17:50:39.402226 7227 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432: attempting to promote NON_VOTER 7ac94f985d6340e983380a2ed849913f to VOTER
I20260808 17:50:39.402320 7533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5eb0483a734342039cd6818b65d8e432" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: NON_VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: true } } }
I20260808 17:50:39.402436 7533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 17:50:39.402412 7227 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true } }
I20260808 17:50:39.402706 7531 mvcc.cc:205] Tried to move back new op lower bound from 7316322051841785856 to 7316322051796041728. Current Snapshot: MvccSnapshot[applied={T|T < 7316322051805777920}]
I20260808 17:50:39.403420 7307 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 1 LEARNER]: Refusing update from remote peer 5eb0483a734342039cd6818b65d8e432: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20260808 17:50:39.403436 6323 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 -> Peer 367f2cd7cc7a4e6cab215ab04f5370c8 (127.28.213.188:33513): Couldn't send request to peer 367f2cd7cc7a4e6cab215ab04f5370c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 17:50:39.403594 7226 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 17:50:39.404219 7226 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 7ac94f985d6340e983380a2ed849913f (127.28.213.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true } } }
I20260808 17:50:39.404914 7226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5eb0483a734342039cd6818b65d8e432" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true } } }
I20260808 17:50:39.404981 7226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:39.405032 7226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5eb0483a734342039cd6818b65d8e432" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true } } }
I20260808 17:50:39.405069 7226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:39.405326 7307 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 7ac94f985d6340e983380a2ed849913f (127.28.213.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true } } }
I20260808 17:50:39.406044 7539 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5eb0483a734342039cd6818b65d8e432" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true } } }
I20260808 17:50:39.406124 7539 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:50:39.410440 7379 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260808 17:50:39.410549 7379 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260808 17:50:39.410593 7379 tablet_replica.cc:330] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: stopping tablet replica
I20260808 17:50:39.423281 7379 master.cc:552] Master@127.28.213.188:33513 shutdown complete.
I20260808 17:50:39.423321 7379 master_runner.cc:305] Clearing existing system tablet
I20260808 17:50:39.423444 7379 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:39.423488 7379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:39.424023 7379 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:39.424453 7547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.424603 7379 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:39.424659 7379 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.424681 7379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/wal
uuid: "367f2cd7cc7a4e6cab215ab04f5370c8"
format_stamp: "Formatted at 2026-08-08 17:50:39 on dist-test-slave-bndk"
server_key: "ca11e161eabf83e6292cfe23b04ef792"
server_key_iv: "ceacd27b29cd5cea9b0f6febd00a0fbc"
server_key_version: "encryptionkey@0"
I20260808 17:50:39.425239 7379 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:39.438887 7379 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 17:50:39.438956 7379 log.cc:1196] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 17:50:39.439153 7379 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: Deleting consensus metadata
I20260808 17:50:39.439257 7379 master_runner.cc:315] Copying system tablet from 127.28.213.190:38625
I20260808 17:50:39.439832 7379 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: tablet copy: Beginning tablet copy session from remote peer at address 127.28.213.190:38625
I20260808 17:50:39.445375 7556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.440140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.0.0.1:39528)
0808 17:50:39.440273 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.440284 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.440350 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.440473 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.440474 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.440646 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.440683 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.440685 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.441358 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.441360 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.441889 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.441890 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.442235 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.442236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.442287 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.442697 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.442703 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.442995 (+ 292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.444407 (+ 1412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.444408 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.444408 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.444576 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.444766 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.444767 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.444767 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.444824 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.445038 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.445039 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.445087 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.445147 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.445272 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":75,"threads_started":1}
I20260808 17:50:39.445379 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.440196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39528 (local address 127.28.213.190:38625)
0808 17:50:39.440248 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.440250 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.440340 (+ 90us) server_negotiation.cc:407] Connection header received
0808 17:50:39.440416 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.440417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.440428 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.440470 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.440755 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.441289 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.441972 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.442174 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.442228 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.443079 (+ 851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.443081 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.443081 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.443089 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.444329 (+ 1240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.444638 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.444639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.444640 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.444701 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.444874 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.444875 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.444876 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.444982 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.445039 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.445176 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.445299 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:50:39.445783 6373 tablet_copy_service.cc:140] P 5eb0483a734342039cd6818b65d8e432: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 367f2cd7cc7a4e6cab215ab04f5370c8 ({username='oryx', principal='oryx/127.28.213.188@KRBTEST.COM'} at 127.0.0.1:39528)
I20260808 17:50:39.445840 6373 tablet_copy_service.cc:161] P 5eb0483a734342039cd6818b65d8e432: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 367f2cd7cc7a4e6cab215ab04f5370c8 at {username='oryx', principal='oryx/127.28.213.188@KRBTEST.COM'} at 127.0.0.1:39528: session id = 367f2cd7cc7a4e6cab215ab04f5370c8-00000000000000000000000000000000
I20260808 17:50:39.446259 6373 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 17:50:39.446713 7379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 17:50:39.447580 7379 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: tablet copy: Starting download of 0 data blocks...
I20260808 17:50:39.447697 7379 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: tablet copy: Starting download of 1 WAL segments...
I20260808 17:50:39.448385 7379 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 17:50:39.449123 6373 tablet_copy_service.cc:342] P 5eb0483a734342039cd6818b65d8e432: Request end of tablet copy session 367f2cd7cc7a4e6cab215ab04f5370c8-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.28.213.188@KRBTEST.COM'} at 127.0.0.1:39528
I20260808 17:50:39.449175 6373 tablet_copy_service.cc:433] P 5eb0483a734342039cd6818b65d8e432: ending tablet copy session 367f2cd7cc7a4e6cab215ab04f5370c8-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 367f2cd7cc7a4e6cab215ab04f5370c8
I20260808 17:50:39.451632 7379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:39.452656 7558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:39.452728 7559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:39.452827 7379 server_base.cc:1034] running on GCE node
W20260808 17:50:39.453338 7564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:39.453467 7379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:39.453699 7379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:39.454842 7379 hybrid_clock.cc:648] HybridClock initialized: now 1786211439454834 us; error 23 us; skew 500 ppm
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:39.456010 7379 init.cc:377] Logged in from keytab as oryx/127.28.213.188@KRBTEST.COM (short username oryx)
I20260808 17:50:39.456231 7379 webserver.cc:460] Webserver started at http://127.28.213.188:42343/ using document root <none> and password file <none>
I20260808 17:50:39.456333 7379 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:39.456357 7379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:39.456928 7379 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.457425 7572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.457530 7379 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.457571 7379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/wal
uuid: "367f2cd7cc7a4e6cab215ab04f5370c8"
format_stamp: "Formatted at 2026-08-08 17:50:39 on dist-test-slave-bndk"
server_key: "ca11e161eabf83e6292cfe23b04ef792"
server_key_iv: "ceacd27b29cd5cea9b0f6febd00a0fbc"
server_key_version: "encryptionkey@0"
I20260808 17:50:39.457623 7379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:39.482779 7379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:39.484244 7379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:39.487545 7379 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.188:33513
I20260808 17:50:39.487567 7648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.188:33513 every 8 connection(s)
I20260808 17:50:39.487843 7379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/master-2/data/info.pb
I20260808 17:50:39.488690 7649 sys_catalog.cc:263] Verifying existing consensus state
I20260808 17:50:39.489145 7649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: Bootstrap starting.
I20260808 17:50:39.491392 7649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:50:39.491604 7649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: Bootstrap complete.
I20260808 17:50:39.491781 7649 raft_consensus.cc:348] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true } }
I20260808 17:50:39.491866 7649 raft_consensus.cc:729] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 367f2cd7cc7a4e6cab215ab04f5370c8, State: Initialized, Role: LEARNER
I20260808 17:50:39.491910 7649 consensus_queue.cc:260] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true } }
I20260808 17:50:39.492082 7649 sys_catalog.cc:564] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:39.492089 7656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true } } }
I20260808 17:50:39.492208 7656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: This master's current role is: LEARNER
I20260808 17:50:39.493553 7673 catalog_manager.cc:1259] Loaded cluster ID: 4df93004cb3247bea06e50359efa3b7b
I20260808 17:50:39.493643 7673 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: loading cluster ID for follower catalog manager: success
I20260808 17:50:39.494532 7673 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: acquiring CA information for follower catalog manager: success
I20260808 17:50:39.494786 7673 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 17:50:39.518272 7674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.512983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37914 (local address 127.28.213.188:33513)
0808 17:50:39.513105 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.513107 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.513117 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:50:39.513140 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.513140 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.513150 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.513224 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.513722 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.514322 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.514958 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.515138 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.515179 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.516283 (+ 1104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.516284 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.516285 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.516291 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.517463 (+ 1172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.517741 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.517742 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.517742 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.517789 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.517923 (+ 134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.517924 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.517924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.518017 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.518082 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.518149 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.518208 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":73,"threads_started":1}
I20260808 17:50:39.518729 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 6438
I20260808 17:50:39.532196 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:33275
--local_ip_for_outbound_sockets=127.28.213.129
--tserver_master_addrs=127.28.213.190:38625
--webserver_port=43199
--webserver_interface=127.28.213.129
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.129.keytab
--principal=oryx/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:42503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.28.213.190:38625,127.28.213.189:43731
--tserver_master_addrs=127.28.213.190:38625,127.28.213.189:43731,127.28.213.188:33513 with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:39.612334 7678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:39.612520 7678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:39.612541 7678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:39.613688 7678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:39.613729 7678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:39.613758 7678 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:50:39.615201 7678 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:42503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.129.keytab
--principal=oryx/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:33275
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=43199
--tserver_master_addrs=127.28.213.190:38625,127.28.213.189:43731,127.28.213.188:33513
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7678
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:39.615411 7678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:39.615615 7678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:39.620299 7693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:39.620330 7686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:39.620304 7684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:39.620491 7678 server_base.cc:1034] running on GCE node
I20260808 17:50:39.620733 7678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:39.620955 7678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:39.622087 7678 hybrid_clock.cc:648] HybridClock initialized: now 1786211439622067 us; error 30 us; skew 500 ppm
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:39.624413 7678 init.cc:377] Logged in from keytab as oryx/127.28.213.129@KRBTEST.COM (short username oryx)
I20260808 17:50:39.624804 7678 webserver.cc:460] Webserver started at http://127.28.213.129:43199/ using document root <none> and password file <none>
I20260808 17:50:39.625000 7678 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:39.625058 7678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:39.626416 7678 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:39.626955 7700 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.627111 7678 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:39.627187 7678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "0435c861f1d04d16a2b5b1f07b049cde"
format_stamp: "Formatted at 2026-08-08 17:50:38 on dist-test-slave-bndk"
server_key: "e243c7f89a62ee170930532169e94653"
server_key_iv: "baec9a1cd6a16d8a1c6d92778202f03d"
server_key_version: "encryptionkey@0"
I20260808 17:50:39.627534 7678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:39.649276 7678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:39.650857 7678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:39.651005 7678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:39.651201 7678 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:39.651490 7678 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:39.651525 7678 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.651551 7678 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:39.651576 7678 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.657604 7678 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:33275
I20260808 17:50:39.657660 7874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:33275 every 8 connection(s)
I20260808 17:50:39.657958 7678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.188@KRBTEST.COM
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.189@KRBTEST.COM
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM
I20260808 17:50:39.666931 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 7678
I20260808 17:50:39.667099 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 6637
I20260808 17:50:39.668107 7674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.658847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:41013 (local address 127.28.213.188:33513)
0808 17:50:39.658898 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.658900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.659080 (+ 180us) server_negotiation.cc:407] Connection header received
0808 17:50:39.660118 (+ 1038us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.660119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.660134 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.660184 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.660778 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.661331 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.662692 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.663009 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.663064 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.665343 (+ 2279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.665345 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.665346 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.665354 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.666732 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.667240 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.667242 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.667242 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.667302 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.667536 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.667537 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.667537 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.667646 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.667679 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.667953 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.668031 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 17:50:39.668491 7884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.658600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:33513 (local address 127.28.213.129:41013)
0808 17:50:39.658942 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.658985 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.659961 (+ 976us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.660193 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.660195 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.660538 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.660671 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.660678 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.661432 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.661433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.662604 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.662606 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.663114 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.663115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.663198 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.663674 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.663682 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.665261 (+ 1579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.666820 (+ 1559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.666827 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.666829 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.667109 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.667361 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.667361 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.667362 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.667477 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.667714 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.667718 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.667842 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.668174 (+ 332us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.668310 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":5,"thread_start_us":87,"threads_started":1}
I20260808 17:50:39.669075 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.658589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:46015 (local address 127.28.213.190:38625)
0808 17:50:39.658638 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.658640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.659064 (+ 424us) server_negotiation.cc:407] Connection header received
0808 17:50:39.660079 (+ 1015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.660080 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.660093 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.660122 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.660754 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.661572 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.663367 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.663583 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.663619 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.666211 (+ 2592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.666212 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.666212 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.666221 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.667716 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.668142 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.668143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.668143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.668210 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.668455 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.668456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.668457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.668599 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.668646 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.668887 (+ 241us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.668971 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:50:39.669482 7882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.658601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.129:46015)
0808 17:50:39.658942 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.658985 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.659958 (+ 973us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.660191 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.660196 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.660496 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.660670 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.660674 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.662696 (+ 2022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.662697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.663279 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.663281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.663723 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.663724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.663787 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.664171 (+ 384us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.664176 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.666128 (+ 1952us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.667821 (+ 1693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.667822 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.667823 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.668047 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.668295 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.668296 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.668297 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.668364 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.668700 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.668701 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.668750 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.669196 (+ 446us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.669357 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":93,"threads_started":1}
I20260808 17:50:39.675339 7877 heartbeater.cc:347] Connected to a master server at 127.28.213.190:38625
I20260808 17:50:39.675442 7877 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:39.675640 7877 heartbeater.cc:511] Master 127.28.213.190:38625 requested a full tablet report, sending...
I20260808 17:50:39.676103 6345 ts_manager.cc:194] Re-registered known tserver with Master: 0435c861f1d04d16a2b5b1f07b049cde (127.28.213.129:33275)
I20260808 17:50:39.676571 6345 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:46015
I20260808 17:50:39.677062 7885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.658999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:43731 (local address 127.28.213.129:46981)
0808 17:50:39.659183 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.659192 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.659966 (+ 774us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.660190 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.660195 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.660540 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.660671 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.660678 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.661642 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.661643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.662604 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.662606 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.663067 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.663068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.663201 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.663711 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.663717 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.666043 (+ 2326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.676063 (+ 10020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.676064 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.676065 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.676255 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.676440 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.676441 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.676441 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.676496 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.676751 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.676752 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.676794 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.676862 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.676966 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":39,"thread_start_us":57,"threads_started":1}
I20260808 17:50:39.677083 7374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.659141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:46981 (local address 127.28.213.189:43731)
0808 17:50:39.659182 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.659184 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.659230 (+ 46us) server_negotiation.cc:407] Connection header received
0808 17:50:39.660052 (+ 822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.660053 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.660064 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.660110 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.660788 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.661563 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.662691 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.662991 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.663054 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.666331 (+ 3277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.666332 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.666332 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.666339 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.676006 (+ 9667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.676331 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.676332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.676332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.676389 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.676547 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.676548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.676548 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.676666 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.676724 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.676911 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.676995 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:50:39.677421 7875 heartbeater.cc:347] Connected to a master server at 127.28.213.188:33513
I20260808 17:50:39.677482 7875 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:39.677558 7875 heartbeater.cc:511] Master 127.28.213.188:33513 requested a full tablet report, sending...
I20260808 17:50:39.677587 7878 heartbeater.cc:347] Connected to a master server at 127.28.213.189:43731
I20260808 17:50:39.677628 7878 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:39.677670 7878 heartbeater.cc:511] Master 127.28.213.189:43731 requested a full tablet report, sending...
I20260808 17:50:39.677912 7593 ts_manager.cc:194] Registered new tserver with Master: 0435c861f1d04d16a2b5b1f07b049cde (127.28.213.129:33275)
I20260808 17:50:39.678020 7295 ts_manager.cc:194] Registered new tserver with Master: 0435c861f1d04d16a2b5b1f07b049cde (127.28.213.129:33275)
I20260808 17:50:39.679653 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:42957
--local_ip_for_outbound_sockets=127.28.213.130
--tserver_master_addrs=127.28.213.190:38625
--webserver_port=34629
--webserver_interface=127.28.213.130
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.130.keytab
--principal=oryx/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:42503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.28.213.190:38625,127.28.213.189:43731
--tserver_master_addrs=127.28.213.190:38625,127.28.213.189:43731,127.28.213.188:33513 with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:39.761190 7886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:39.761420 7886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:39.761441 7886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:39.762567 7886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:39.762609 7886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:39.762636 7886 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:50:39.764082 7886 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:42503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.130.keytab
--principal=oryx/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:42957
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=34629
--tserver_master_addrs=127.28.213.190:38625,127.28.213.189:43731,127.28.213.188:33513
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7886
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:39.764307 7886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:39.764528 7886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:39.769209 7894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:39.769306 7886 server_base.cc:1034] running on GCE node
W20260808 17:50:39.769249 7895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:39.769207 7897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:39.769609 7886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:39.769811 7886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:39.770957 7886 hybrid_clock.cc:648] HybridClock initialized: now 1786211439770944 us; error 32 us; skew 500 ppm
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:39.773368 7886 init.cc:377] Logged in from keytab as oryx/127.28.213.130@KRBTEST.COM (short username oryx)
I20260808 17:50:39.773780 7886 webserver.cc:460] Webserver started at http://127.28.213.130:34629/ using document root <none> and password file <none>
I20260808 17:50:39.773957 7886 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:39.774010 7886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:39.775215 7886 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:39.775699 7907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.775844 7886 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.775924 7886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "93741712302c47528a0c85bd02d5b377"
format_stamp: "Formatted at 2026-08-08 17:50:38 on dist-test-slave-bndk"
server_key: "0d06d238e024737385192c93d555074d"
server_key_iv: "05bcde22b6ce3598a01adf5c7cfa4224"
server_key_version: "encryptionkey@0"
I20260808 17:50:39.776211 7886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:39.789405 7886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:39.790951 7886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:39.791074 7886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:39.791256 7886 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:39.791536 7886 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:39.791568 7886 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.791595 7886 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:39.791618 7886 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.797708 7886 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:42957
I20260808 17:50:39.797744 8077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:42957 every 8 connection(s)
I20260808 17:50:39.798064 7886 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:50:39.804704 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 7886
I20260808 17:50:39.804865 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 6852
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.189@KRBTEST.COM
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.188@KRBTEST.COM
I20260808 17:50:39.812476 7224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.803397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:33513 (local address 127.0.0.1:37920)
0808 17:50:39.803440 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.803448 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.803484 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.804132 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.804133 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.804135 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:39.804175 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.804176 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.804935 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.804936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.806025 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.806028 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.812236 (+ 6208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.812237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.812314 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.812319 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.812351 (+ 32us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.812402 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 17:50:39.812952 8089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.803829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37920 (local address 127.28.213.188:33513)
0808 17:50:39.803958 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.803960 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.803966 (+ 6us) server_negotiation.cc:407] Connection header received
0808 17:50:39.803983 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.803984 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.804002 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.804104 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:39.804245 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.804793 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.811637 (+ 6844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.812131 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.812731 (+ 600us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.812811 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.812832 (+ 21us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.812881 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":53,"threads_started":1}
I20260808 17:50:39.815131 7674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.799035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:51325 (local address 127.28.213.188:33513)
0808 17:50:39.799088 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.799091 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.799102 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:50:39.799946 (+ 844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.799947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.799959 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.800010 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.800794 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.801573 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.802767 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.803070 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.803134 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.811384 (+ 8250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.811386 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.811386 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.811395 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.813777 (+ 2382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.814258 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.814260 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.814260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.814333 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.814591 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.814592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.814592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.814731 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.814774 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.814973 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.815049 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:50:39.815169 7374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.799100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:60759 (local address 127.28.213.189:43731)
0808 17:50:39.799154 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.799155 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.800068 (+ 913us) server_negotiation.cc:407] Connection header received
0808 17:50:39.800118 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.800119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.800130 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.800182 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.800787 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.801366 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.802769 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.803068 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.803147 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.810907 (+ 7760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.810908 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.810908 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.810915 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.813007 (+ 2092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.814061 (+ 1054us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.814062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.814063 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.814106 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.814654 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.814655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.814655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.814779 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.814829 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.815008 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.815083 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:50:39.815492 7605 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 17:50:39.815570 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.798973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:39275 (local address 127.28.213.190:38625)
0808 17:50:39.799159 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.799161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.799170 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:50:39.799945 (+ 775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.799946 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.799959 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.800010 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.800767 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.801584 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.803477 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.803749 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.803792 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.810657 (+ 6865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.810659 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.810659 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.810668 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.813016 (+ 2348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.813759 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.813761 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.813761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.813830 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.814248 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.814249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.814249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.814349 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.814383 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.815410 (+ 1027us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.815487 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155}
I20260808 17:50:39.815593 8084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.798710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:33513 (local address 127.28.213.130:51325)
0808 17:50:39.798878 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.798917 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.799843 (+ 926us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.800085 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.800090 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.800499 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.800678 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.800684 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.801650 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.801651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.802691 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.802694 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.803488 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.803489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.803563 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.809339 (+ 5776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.809344 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.811296 (+ 1952us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.813886 (+ 2590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.813887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.813888 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.814152 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.814420 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.814421 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.814422 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.814495 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.814819 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.814819 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.814860 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.815210 (+ 350us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.815385 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":12,"thread_start_us":96,"threads_started":1}
I20260808 17:50:39.815629 7656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5eb0483a734342039cd6818b65d8e432. Latest consensus state: current_term: 1 leader_uuid: "5eb0483a734342039cd6818b65d8e432" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true } } }
I20260808 17:50:39.815718 7656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: This master's current role is: LEARNER
I20260808 17:50:39.815850 8083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.798710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:43731 (local address 127.28.213.130:60759)
0808 17:50:39.800011 (+ 1301us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.800020 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.800070 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.800185 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.800186 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.800503 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.800678 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.800684 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.801484 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.801485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.802691 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.802694 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.803161 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.803162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.803291 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.803742 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.803751 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.810828 (+ 7077us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.813091 (+ 2263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.813098 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.813101 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.813519 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.814158 (+ 639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.814158 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.814158 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.814196 (+ 38us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.814872 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.814873 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.814910 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.815281 (+ 371us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.815740 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1276,"mutex_wait_us":351,"thread_start_us":95,"threads_started":1}
I20260808 17:50:39.816089 8085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.798711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.130:39275)
0808 17:50:39.799020 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.799030 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.799851 (+ 821us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.800085 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.800090 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.800499 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.800678 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.800682 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.802788 (+ 2106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.802789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.803375 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.803377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.803868 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.803869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.803931 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.804287 (+ 356us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.804302 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.810555 (+ 6253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.813178 (+ 2623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.813179 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.813180 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.813684 (+ 504us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.813889 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.813890 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.813890 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.814000 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.814417 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.814422 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.814555 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.815913 (+ 1358us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.816002 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"spinlock_wait_cycles":7040,"thread_start_us":109,"threads_started":1}
I20260808 17:50:39.816218 8080 heartbeater.cc:347] Connected to a master server at 127.28.213.189:43731
I20260808 17:50:39.816303 8080 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:39.816473 8080 heartbeater.cc:511] Master 127.28.213.189:43731 requested a full tablet report, sending...
I20260808 17:50:39.816749 8079 heartbeater.cc:347] Connected to a master server at 127.28.213.190:38625
I20260808 17:50:39.816877 7295 ts_manager.cc:194] Registered new tserver with Master: 93741712302c47528a0c85bd02d5b377 (127.28.213.130:42957)
I20260808 17:50:39.816762 8078 heartbeater.cc:347] Connected to a master server at 127.28.213.188:33513
I20260808 17:50:39.817065 8078 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:39.817147 8078 heartbeater.cc:511] Master 127.28.213.188:33513 requested a full tablet report, sending...
I20260808 17:50:39.817054 8079 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:39.817335 8079 heartbeater.cc:511] Master 127.28.213.190:38625 requested a full tablet report, sending...
I20260808 17:50:39.817471 7593 ts_manager.cc:194] Registered new tserver with Master: 93741712302c47528a0c85bd02d5b377 (127.28.213.130:42957)
I20260808 17:50:39.817544 6345 ts_manager.cc:194] Re-registered known tserver with Master: 93741712302c47528a0c85bd02d5b377 (127.28.213.130:42957)
I20260808 17:50:39.817914 6345 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:39275
I20260808 17:50:39.820132 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:33753
--local_ip_for_outbound_sockets=127.28.213.131
--tserver_master_addrs=127.28.213.190:38625
--webserver_port=34739
--webserver_interface=127.28.213.131
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.131.keytab
--principal=oryx/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:42503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.28.213.190:38625,127.28.213.189:43731
--tserver_master_addrs=127.28.213.190:38625,127.28.213.189:43731,127.28.213.188:33513 with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:39.900151 8090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:39.900339 8090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:39.900370 8090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:39.901499 8090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:39.901539 8090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:39.901573 8090 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:50:39.903010 8090 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:42503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.131.keytab
--principal=oryx/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:33753
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=34739
--tserver_master_addrs=127.28.213.190:38625,127.28.213.189:43731,127.28.213.188:33513
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8090
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:39.903231 8090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:39.903434 8090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:39.908102 8102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:39.908107 8101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:39.908228 8090 server_base.cc:1034] running on GCE node
W20260808 17:50:39.908089 8104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:39.908438 8090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:39.908648 8090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:39.909781 8090 hybrid_clock.cc:648] HybridClock initialized: now 1786211439909764 us; error 28 us; skew 500 ppm
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:39.912034 8090 init.cc:377] Logged in from keytab as oryx/127.28.213.131@KRBTEST.COM (short username oryx)
I20260808 17:50:39.912400 8090 webserver.cc:460] Webserver started at http://127.28.213.131:34739/ using document root <none> and password file <none>
I20260808 17:50:39.912609 8090 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:39.912672 8090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:39.913928 8090 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260808 17:50:39.914415 8112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.914574 8090 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:39.914664 8090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "49cc6e8f7b8348a0ac937675ff758922"
format_stamp: "Formatted at 2026-08-08 17:50:38 on dist-test-slave-bndk"
server_key: "6449d5930846a79aff964fe632956d6f"
server_key_iv: "f1d08e5563bdb226d6eecb134ed0295c"
server_key_version: "encryptionkey@0"
I20260808 17:50:39.914947 8090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:39.923257 8090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:39.925133 8090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:39.925287 8090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:39.925478 8090 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:39.925738 8090 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:39.925770 8090 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.925797 8090 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:39.925822 8090 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:39.931401 8090 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:33753
I20260808 17:50:39.931454 8291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:33753 every 8 connection(s)
I20260808 17:50:39.931751 8090 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:50:39.934870 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 8090
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.189@KRBTEST.COM
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM
Aug 08 17:50:39 dist-test-slave-bndk krb5kdc[6263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211439, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.188@KRBTEST.COM
I20260808 17:50:39.946094 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.932598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:44501 (local address 127.28.213.190:38625)
0808 17:50:39.932642 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.932644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.932652 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:39.933703 (+ 1051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.933705 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.933717 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.933748 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.934472 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.935226 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.937702 (+ 2476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.938025 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.938070 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.940811 (+ 2741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.940813 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.940813 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.940820 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.942607 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.944346 (+ 1739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.944347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.944348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.944652 (+ 304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.944935 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.944937 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.944937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.945085 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.945136 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.945930 (+ 794us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.945999 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:50:39.946102 7674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.932859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:50361 (local address 127.28.213.188:33513)
0808 17:50:39.932901 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.932903 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.932912 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:50:39.933703 (+ 791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.933705 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.933717 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.933748 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.934462 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.935187 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.936720 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.936997 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.937061 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.941906 (+ 4845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.941907 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.941908 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.941915 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.943358 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.944490 (+ 1132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.944491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.944491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.944551 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.945513 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.945514 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.945515 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.945638 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.945680 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.945894 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.946022 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:50:39.946223 8305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.932673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:33513 (local address 127.28.213.131:50361)
0808 17:50:39.932808 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.932818 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.933588 (+ 770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.933852 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.933853 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.934165 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.934345 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.934351 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.935315 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.935315 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.936639 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.936641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.939962 (+ 3321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.939963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.940030 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.940389 (+ 359us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.940394 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.941823 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.943479 (+ 1656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.943481 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.943481 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.944040 (+ 559us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.945351 (+ 1311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.945352 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.945352 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.945434 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.945726 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.945726 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.945766 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.945839 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.946004 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":130,"thread_start_us":81,"threads_started":1}
I20260808 17:50:39.946426 8299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.932357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.131:44501)
0808 17:50:39.932536 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.932572 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.933580 (+ 1008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.933850 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.933853 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.934143 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.934345 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.934351 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.935321 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.935322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.937380 (+ 2058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.937383 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.938146 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.938147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.938217 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.938614 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.938619 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.940714 (+ 2095us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.942699 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.942707 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.942709 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.944261 (+ 1552us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.944726 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.944727 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.944727 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.944854 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.945164 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.945171 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.945340 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.946204 (+ 864us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.946310 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":1171,"thread_start_us":106,"threads_started":1}
I20260808 17:50:39.946671 8293 heartbeater.cc:347] Connected to a master server at 127.28.213.188:33513
I20260808 17:50:39.946719 7374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.932383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:36645 (local address 127.28.213.189:43731)
0808 17:50:39.932435 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.932438 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.932641 (+ 203us) server_negotiation.cc:407] Connection header received
0808 17:50:39.933675 (+ 1034us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.933676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.933689 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.933752 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.934428 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.935230 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.936743 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.937042 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.937082 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.941093 (+ 4011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.941095 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.941095 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.941102 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.943315 (+ 2213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.944006 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.944007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.944007 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.944141 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.945551 (+ 1410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.945552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.945552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.945683 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.945723 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.946560 (+ 837us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.946634 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:50:39.946758 8293 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:39.946941 8293 heartbeater.cc:511] Master 127.28.213.188:33513 requested a full tablet report, sending...
I20260808 17:50:39.947314 8294 heartbeater.cc:347] Connected to a master server at 127.28.213.190:38625
I20260808 17:50:39.947366 8294 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:39.947378 7593 ts_manager.cc:194] Registered new tserver with Master: 49cc6e8f7b8348a0ac937675ff758922 (127.28.213.131:33753)
I20260808 17:50:39.947433 8294 heartbeater.cc:511] Master 127.28.213.190:38625 requested a full tablet report, sending...
I20260808 17:50:39.947441 8316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.936062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57826 (local address 127.28.213.189:43731)
0808 17:50:39.936270 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.936272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.936537 (+ 265us) server_negotiation.cc:407] Connection header received
0808 17:50:39.936625 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.936626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.936639 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.936679 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.937534 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.938229 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.941685 (+ 3456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.941976 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.942017 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.943735 (+ 1718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.943736 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.943737 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.943744 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.945255 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.946583 (+ 1328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.946584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.946585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.946652 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.946861 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.946862 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.946862 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.946999 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.947075 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.947280 (+ 205us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.947360 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":51,"threads_started":1}
I20260808 17:50:39.947654 6345 ts_manager.cc:194] Re-registered known tserver with Master: 49cc6e8f7b8348a0ac937675ff758922 (127.28.213.131:33753)
I20260808 17:50:39.948072 6345 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:44501
I20260808 17:50:39.948304 8302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.932357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:43731 (local address 127.28.213.131:36645)
0808 17:50:39.932533 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.932571 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.933583 (+ 1012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.933848 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.933852 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.934129 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:39.934343 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.934347 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.935394 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.935394 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.936639 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.936641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.937161 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.937162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.937315 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.938365 (+ 1050us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:39.938375 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:39.940401 (+ 2026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:39.943417 (+ 3016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.943418 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.943419 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.943773 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.944504 (+ 731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:39.944505 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:39.944505 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:39.945476 (+ 971us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:39.945768 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:39.945769 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:39.945810 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.946816 (+ 1006us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.946906 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":76,"thread_start_us":99,"threads_started":1}
I20260808 17:50:39.948592 8295 heartbeater.cc:347] Connected to a master server at 127.28.213.189:43731
I20260808 17:50:39.948630 8295 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:39.948710 8295 heartbeater.cc:511] Master 127.28.213.189:43731 requested a full tablet report, sending...
I20260808 17:50:39.948936 8089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.936273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37924 (local address 127.28.213.188:33513)
0808 17:50:39.936311 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.936313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.937149 (+ 836us) server_negotiation.cc:407] Connection header received
0808 17:50:39.937851 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.937852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.937864 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.937920 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.939485 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.940157 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.942299 (+ 2142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.942573 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.942611 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.944531 (+ 1920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.944532 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.944532 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.944538 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.946084 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.948160 (+ 2076us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.948161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.948161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.948211 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.948399 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.948400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.948400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.948513 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.948591 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.948769 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.948858 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:50:39.949064 8314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.935906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39544 (local address 127.28.213.190:38625)
0808 17:50:39.936528 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.936530 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.936538 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:39.936561 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.936562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.936574 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.937851 (+ 1277us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:39.937893 (+ 42us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.938611 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.939554 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.939848 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.939906 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.942986 (+ 3080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:39.942988 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:39.942988 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:39.942995 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:39.945629 (+ 2634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.948010 (+ 2381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.948011 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.948012 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.948070 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:39.948263 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:39.948263 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:39.948264 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:39.948384 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:39.948478 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.948837 (+ 359us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.948985 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":46,"threads_started":1}
I20260808 17:50:39.949282 7295 ts_manager.cc:194] Registered new tserver with Master: 49cc6e8f7b8348a0ac937675ff758922 (127.28.213.131:33753)
I20260808 17:50:39.950443 6345 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39544:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:50:39.951972 6345 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:50:39.952654 7542 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5eb0483a734342039cd6818b65d8e432" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: NON_VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: true } } }
I20260808 17:50:39.952749 7542 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:39.953603 8326 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432: attempting to promote NON_VOTER 367f2cd7cc7a4e6cab215ab04f5370c8 to VOTER
I20260808 17:50:39.953749 8326 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: false } }
I20260808 17:50:39.954151 7605 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 1 LEARNER]: Refusing update from remote peer 5eb0483a734342039cd6818b65d8e432: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 17:50:39.954334 7307 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 1 FOLLOWER]: Refusing update from remote peer 5eb0483a734342039cd6818b65d8e432: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 17:50:39.954365 8324 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [LEADER]: Connected to new peer: Peer: permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 17:50:39.954490 8324 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 17:50:39.955129 7542 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 367f2cd7cc7a4e6cab215ab04f5370c8 (127.28.213.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: false } } }
I20260808 17:50:39.955329 7307 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 367f2cd7cc7a4e6cab215ab04f5370c8 (127.28.213.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: false } } }
I20260808 17:50:39.955351 7605 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 367f2cd7cc7a4e6cab215ab04f5370c8 (127.28.213.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: false } } }
I20260808 17:50:39.955941 7542 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5eb0483a734342039cd6818b65d8e432" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: false } } }
I20260808 17:50:39.956010 7542 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:39.956061 7542 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5eb0483a734342039cd6818b65d8e432" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: false } } }
I20260808 17:50:39.956101 7542 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:39.956142 7542 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5eb0483a734342039cd6818b65d8e432" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: false } } }
I20260808 17:50:39.956178 7542 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:39.956269 7656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5eb0483a734342039cd6818b65d8e432" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: false } } }
I20260808 17:50:39.956353 7656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:50:39.956619 8338 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5eb0483a734342039cd6818b65d8e432" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: false } } }
I20260808 17:50:39.956710 8338 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:50:39.961925 8340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.958121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:42957 (local address 127.0.0.1:55006)
0808 17:50:39.958497 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.958508 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.958553 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.959002 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.959003 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.959005 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:39.959032 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.959033 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.959831 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.959832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.961010 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.961012 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.961702 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.961704 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.961762 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.961766 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.961822 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.961857 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"mutex_wait_us":47,"thread_start_us":66,"threads_started":1}
I20260808 17:50:39.962122 7224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.958077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:33753 (local address 127.0.0.1:53068)
0808 17:50:39.958108 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.958119 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.958155 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.958682 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.958683 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.958685 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:39.958727 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.958728 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.959934 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.959934 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.961002 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.961004 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.961926 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.961927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.961989 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.961993 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.962022 (+ 29us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.962058 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17,"mutex_wait_us":4}
I20260808 17:50:39.962198 8346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.958338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55006 (local address 127.28.213.130:42957)
0808 17:50:39.958791 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.958795 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.958805 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:50:39.958840 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.958843 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.958857 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.958941 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:39.959096 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.959754 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.961099 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.961626 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.961707 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.961771 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.961836 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.961876 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":80,"threads_started":1}
I20260808 17:50:39.962488 8345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.958329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53068 (local address 127.28.213.131:33753)
0808 17:50:39.958535 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.958539 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.958548 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:50:39.958582 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.958584 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.958598 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.958672 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:39.958798 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.959859 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.961081 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.961814 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.962306 (+ 492us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.962361 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.962384 (+ 23us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.962420 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":68,"threads_started":1}
I20260808 17:50:39.962553 8341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.958158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:33275 (local address 127.0.0.1:53614)
0808 17:50:39.958620 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:39.958628 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:39.958665 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:39.958848 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:39.958849 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:39.958850 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:39.958899 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.958900 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.960026 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.960027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.960834 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:39.960836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.962323 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.962324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:39.962394 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.962398 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:39.962458 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 17:50:39.962493 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":76,"threads_started":1}
I20260808 17:50:39.962797 8342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:39.958248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53614 (local address 127.28.213.129:33275)
0808 17:50:39.958463 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:39.958467 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:39.958719 (+ 252us) server_negotiation.cc:407] Connection header received
0808 17:50:39.958759 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:39.958762 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:39.958778 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:39.958854 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:39.958954 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.959968 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.960901 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:39.962154 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:39.962229 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:39.962286 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:39.962678 (+ 392us) server_negotiation.cc:299] Negotiation successful
0808 17:50:39.962721 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":95,"threads_started":1}
I20260808 17:50:39.962882 7980 tablet_service.cc:1467] Processing CreateTablet for tablet 02d38d4cbb6641f990499ff14e522091 (DEFAULT_TABLE table=test-table [id=df3f1add153e4fa7a025065ecdaf1edb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:39.963054 8193 tablet_service.cc:1467] Processing CreateTablet for tablet 02d38d4cbb6641f990499ff14e522091 (DEFAULT_TABLE table=test-table [id=df3f1add153e4fa7a025065ecdaf1edb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:39.963289 7980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02d38d4cbb6641f990499ff14e522091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:39.963392 8193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02d38d4cbb6641f990499ff14e522091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:39.963472 7764 tablet_service.cc:1467] Processing CreateTablet for tablet 02d38d4cbb6641f990499ff14e522091 (DEFAULT_TABLE table=test-table [id=df3f1add153e4fa7a025065ecdaf1edb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:39.963788 7764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02d38d4cbb6641f990499ff14e522091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:39.966151 8347 tablet_bootstrap.cc:492] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377: Bootstrap starting.
I20260808 17:50:39.966758 8349 tablet_bootstrap.cc:492] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922: Bootstrap starting.
I20260808 17:50:39.966794 8347 tablet_bootstrap.cc:654] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:39.967067 8351 tablet_bootstrap.cc:492] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde: Bootstrap starting.
I20260808 17:50:39.967344 8347 log.cc:824] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:39.967386 8349 tablet_bootstrap.cc:654] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:39.967617 8351 tablet_bootstrap.cc:654] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:39.967684 8349 log.cc:824] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:39.967941 8351 log.cc:824] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:39.968268 8347 tablet_bootstrap.cc:492] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377: No bootstrap required, opened a new log
I20260808 17:50:39.968343 8347 ts_tablet_manager.cc:1397] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:50:39.968357 8349 tablet_bootstrap.cc:492] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922: No bootstrap required, opened a new log
I20260808 17:50:39.968425 8349 ts_tablet_manager.cc:1397] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:50:39.968744 8351 tablet_bootstrap.cc:492] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde: No bootstrap required, opened a new log
I20260808 17:50:39.968807 8351 ts_tablet_manager.cc:1397] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:50:39.969867 8347 raft_consensus.cc:348] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } } peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } }
I20260808 17:50:39.969993 8347 raft_consensus.cc:374] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:39.970026 8347 raft_consensus.cc:729] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93741712302c47528a0c85bd02d5b377, State: Initialized, Role: FOLLOWER
I20260808 17:50:39.970134 8347 consensus_queue.cc:260] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } } peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } }
I20260808 17:50:39.970379 8347 ts_tablet_manager.cc:1428] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:50:39.970517 8079 heartbeater.cc:503] Master 127.28.213.190:38625 was elected leader, sending a full tablet report...
I20260808 17:50:39.970677 8351 raft_consensus.cc:348] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } } peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } }
I20260808 17:50:39.970829 8351 raft_consensus.cc:374] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:39.970863 8351 raft_consensus.cc:729] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0435c861f1d04d16a2b5b1f07b049cde, State: Initialized, Role: FOLLOWER
I20260808 17:50:39.970993 8351 consensus_queue.cc:260] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } } peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } }
I20260808 17:50:39.971237 8351 ts_tablet_manager.cc:1428] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:50:39.971374 7877 heartbeater.cc:503] Master 127.28.213.190:38625 was elected leader, sending a full tablet report...
I20260808 17:50:39.971948 8349 raft_consensus.cc:348] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } } peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } }
I20260808 17:50:39.972069 8349 raft_consensus.cc:374] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:39.972097 8349 raft_consensus.cc:729] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49cc6e8f7b8348a0ac937675ff758922, State: Initialized, Role: FOLLOWER
I20260808 17:50:39.972203 8349 consensus_queue.cc:260] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } } peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } }
I20260808 17:50:39.972472 8349 ts_tablet_manager.cc:1428] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 17:50:39.972599 8294 heartbeater.cc:503] Master 127.28.213.190:38625 was elected leader, sending a full tablet report...
W20260808 17:50:40.048761 8082 tablet.cc:2369] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:50:40.095921 8359 raft_consensus.cc:482] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:50:40.096035 8359 raft_consensus.cc:504] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } } peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } }
I20260808 17:50:40.096393 8359 leader_election.cc:288] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93741712302c47528a0c85bd02d5b377 (127.28.213.130:42957), 0435c861f1d04d16a2b5b1f07b049cde (127.28.213.129:33275)
I20260808 17:50:40.099057 8342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:40.096679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:39497 (local address 127.28.213.129:33275)
0808 17:50:40.096721 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:40.096722 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:40.096730 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:40.096753 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:40.096753 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:40.096762 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:40.096814 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:40.096973 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:40.097499 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:40.098344 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:40.098761 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:40.098825 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:40.098834 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:40.098958 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 17:50:40.098992 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:50:40.099092 8302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:40.096539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:42957 (local address 127.28.213.131:37647)
0808 17:50:40.096592 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:40.096605 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:40.096649 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:40.096782 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:40.096783 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:40.096785 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:40.096867 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:40.096869 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:40.097534 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:40.097535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:40.098290 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:40.098292 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:40.098835 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:40.098836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:40.098920 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:40.098923 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:50:40.098975 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 17:50:40.099010 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 17:50:40.099104 8346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:40.096596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:37647 (local address 127.28.213.130:42957)
0808 17:50:40.096634 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:40.096636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:40.096648 (+ 12us) server_negotiation.cc:407] Connection header received
0808 17:50:40.096707 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:40.096708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:40.096717 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:40.096768 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:40.096927 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:40.097465 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:40.098377 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:40.098764 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:40.098827 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:40.098836 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:40.099003 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 17:50:40.099043 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:50:40.099259 8299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:40.096571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:33275 (local address 127.28.213.131:39497)
0808 17:50:40.096629 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:40.096638 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:40.096677 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:40.096827 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:40.096828 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:40.096829 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:40.096908 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:40.096910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:40.097582 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:40.097583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:40.098266 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:40.098268 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:40.098832 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:40.098833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:40.098896 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:40.098899 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:50:40.098939 (+ 40us) client_negotiation.cc:240] Negotiation successful
0808 17:50:40.098972 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 17:50:40.099798 7801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02d38d4cbb6641f990499ff14e522091" candidate_uuid: "49cc6e8f7b8348a0ac937675ff758922" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0435c861f1d04d16a2b5b1f07b049cde" is_pre_election: true
I20260808 17:50:40.099844 8014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02d38d4cbb6641f990499ff14e522091" candidate_uuid: "49cc6e8f7b8348a0ac937675ff758922" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93741712302c47528a0c85bd02d5b377" is_pre_election: true
I20260808 17:50:40.099963 8014 raft_consensus.cc:2454] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49cc6e8f7b8348a0ac937675ff758922 in term 0.
I20260808 17:50:40.099964 7801 raft_consensus.cc:2454] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49cc6e8f7b8348a0ac937675ff758922 in term 0.
I20260808 17:50:40.100186 8116 leader_election.cc:302] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0435c861f1d04d16a2b5b1f07b049cde, 49cc6e8f7b8348a0ac937675ff758922, 93741712302c47528a0c85bd02d5b377; no voters:
I20260808 17:50:40.100348 8359 raft_consensus.cc:2781] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:50:40.100404 8359 raft_consensus.cc:482] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:50:40.100423 8359 raft_consensus.cc:3037] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:40.101115 8359 raft_consensus.cc:504] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } } peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } }
I20260808 17:50:40.101248 8359 leader_election.cc:288] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [CANDIDATE]: Term 1 election: Requested vote from peers 93741712302c47528a0c85bd02d5b377 (127.28.213.130:42957), 0435c861f1d04d16a2b5b1f07b049cde (127.28.213.129:33275)
I20260808 17:50:40.101377 7801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02d38d4cbb6641f990499ff14e522091" candidate_uuid: "49cc6e8f7b8348a0ac937675ff758922" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0435c861f1d04d16a2b5b1f07b049cde"
I20260808 17:50:40.101377 8014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02d38d4cbb6641f990499ff14e522091" candidate_uuid: "49cc6e8f7b8348a0ac937675ff758922" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93741712302c47528a0c85bd02d5b377"
I20260808 17:50:40.101454 8014 raft_consensus.cc:3037] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:40.101455 7801 raft_consensus.cc:3037] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:40.102295 8014 raft_consensus.cc:2454] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49cc6e8f7b8348a0ac937675ff758922 in term 1.
I20260808 17:50:40.102295 7801 raft_consensus.cc:2454] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49cc6e8f7b8348a0ac937675ff758922 in term 1.
I20260808 17:50:40.102449 8114 leader_election.cc:302] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0435c861f1d04d16a2b5b1f07b049cde, 49cc6e8f7b8348a0ac937675ff758922; no voters:
I20260808 17:50:40.102587 8359 raft_consensus.cc:2781] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:40.102736 8359 raft_consensus.cc:686] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [term 1 LEADER]: Becoming Leader. State: Replica: 49cc6e8f7b8348a0ac937675ff758922, State: Running, Role: LEADER
I20260808 17:50:40.102830 8359 consensus_queue.cc:237] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } } peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } }
I20260808 17:50:40.103569 6345 catalog_manager.cc:5495] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49cc6e8f7b8348a0ac937675ff758922 (127.28.213.131). New cstate: current_term: 1 leader_uuid: "49cc6e8f7b8348a0ac937675ff758922" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } health_report { overall_health: UNKNOWN } } }
I20260808 17:50:40.139118 8345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:40.136975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53084 (local address 127.28.213.131:33753)
0808 17:50:40.137024 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:40.137026 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:40.137034 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:40.137088 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:40.137089 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:40.137104 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:40.137160 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:40.137305 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:40.137744 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:40.138445 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:40.138625 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:40.138677 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:40.138827 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:40.138925 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:40.138994 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:40.139033 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 17:50:40.139052 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:50:40.140729 8014 raft_consensus.cc:1261] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377 [term 1 FOLLOWER]: Refusing update from remote peer 49cc6e8f7b8348a0ac937675ff758922: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:40.140728 7801 raft_consensus.cc:1261] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde [term 1 FOLLOWER]: Refusing update from remote peer 49cc6e8f7b8348a0ac937675ff758922: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:40.141064 8362 consensus_queue.cc:1035] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:40.141184 8359 consensus_queue.cc:1035] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:40.143859 8369 mvcc.cc:205] Tried to move back new op lower bound from 7316322058814054400 to 7316322058661806080. Current Snapshot: MvccSnapshot[applied={T|T < 7316322058814054400}]
I20260808 17:50:40.144032 8370 mvcc.cc:205] Tried to move back new op lower bound from 7316322058814054400 to 7316322058661806080. Current Snapshot: MvccSnapshot[applied={T|T < 7316322058814054400}]
I20260808 17:50:40.147532 6343 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:40.147634 6343 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:40.149297 6343 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5eb0483a734342039cd6818b65d8e432: Sending DeleteTablet for 3 replicas of tablet 02d38d4cbb6641f990499ff14e522091
I20260808 17:50:40.149646 7980 tablet_service.cc:1514] Processing DeleteTablet for tablet 02d38d4cbb6641f990499ff14e522091 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:40 UTC) from {username='oryx', principal='oryx/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:55006
I20260808 17:50:40.149681 7764 tablet_service.cc:1514] Processing DeleteTablet for tablet 02d38d4cbb6641f990499ff14e522091 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:40 UTC) from {username='oryx', principal='oryx/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:53614
I20260808 17:50:40.149840 8384 tablet_replica.cc:330] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377: stopping tablet replica
I20260808 17:50:40.149888 8386 tablet_replica.cc:330] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde: stopping tablet replica
I20260808 17:50:40.149924 8384 raft_consensus.cc:2229] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:40.149977 8386 raft_consensus.cc:2229] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:40.150017 8384 raft_consensus.cc:2258] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:40.150068 8386 raft_consensus.cc:2258] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:40.150797 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 6283
I20260808 17:50:40.150851 8386 ts_tablet_manager.cc:1905] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:40.154528 8386 ts_tablet_manager.cc:1918] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:50:40.154604 8386 log.cc:1196] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-0/wal/wals/02d38d4cbb6641f990499ff14e522091
I20260808 17:50:40.154848 8386 ts_tablet_manager.cc:1939] T 02d38d4cbb6641f990499ff14e522091 P 0435c861f1d04d16a2b5b1f07b049cde: Deleting consensus metadata
I20260808 17:50:40.159019 8193 tablet_service.cc:1514] Processing DeleteTablet for tablet 02d38d4cbb6641f990499ff14e522091 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:40 UTC) from {username='oryx', principal='oryx/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:53068
I20260808 17:50:40.159269 8387 tablet_replica.cc:330] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922: stopping tablet replica
I20260808 17:50:40.159389 8387 raft_consensus.cc:2229] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:50:40.159422 8384 ts_tablet_manager.cc:1905] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:40.159554 8387 raft_consensus.cc:2258] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:40.160622 8387 ts_tablet_manager.cc:1905] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:40.160804 8384 ts_tablet_manager.cc:1918] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:50:40.160880 8384 log.cc:1196] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/02d38d4cbb6641f990499ff14e522091
I20260808 17:50:40.161135 8384 ts_tablet_manager.cc:1939] T 02d38d4cbb6641f990499ff14e522091 P 93741712302c47528a0c85bd02d5b377: Deleting consensus metadata
I20260808 17:50:40.162345 8387 ts_tablet_manager.cc:1918] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:50:40.162428 8387 log.cc:1196] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/02d38d4cbb6641f990499ff14e522091
I20260808 17:50:40.162659 8387 ts_tablet_manager.cc:1939] T 02d38d4cbb6641f990499ff14e522091 P 49cc6e8f7b8348a0ac937675ff758922: Deleting consensus metadata
W20260808 17:50:40.166723 7704 connection.cc:535] server connection from 127.0.0.1:53614 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 17:50:40.166734 7914 connection.cc:535] server connection from 127.0.0.1:55006 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 17:50:40.166829 8116 connection.cc:535] server connection from 127.0.0.1:53068 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 17:50:40.167040 7576 connection.cc:535] server connection from 127.0.0.1:37920 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 17:50:40.176147 8089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:40.168516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37930 (local address 127.28.213.188:33513)
0808 17:50:40.168551 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:40.168552 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:40.168691 (+ 139us) server_negotiation.cc:407] Connection header received
0808 17:50:40.168787 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:40.168788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:40.168798 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:40.168826 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:40.169555 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:40.170354 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:40.171263 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:40.171599 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:40.171667 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:40.173436 (+ 1769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:40.173437 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:40.173438 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:40.173446 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:40.175018 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:40.175374 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:40.175375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:40.175375 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:40.175468 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:40.175668 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:40.175669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:40.175669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:40.175785 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:40.175869 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:40.175969 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 17:50:40.176052 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:50:40.176347 8316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:40.168396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57832 (local address 127.28.213.189:43731)
0808 17:50:40.168450 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:40.168452 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:40.168579 (+ 127us) server_negotiation.cc:407] Connection header received
0808 17:50:40.168675 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:40.168676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:40.168690 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:40.168740 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:40.169574 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:40.170102 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:40.171014 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:40.171321 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:40.171352 (+ 31us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:40.172577 (+ 1225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:40.172579 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:40.172579 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:40.172587 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:40.174323 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:40.175458 (+ 1135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:40.175459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:40.175460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:40.175513 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:40.175707 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:40.175709 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:40.175709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:40.175848 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:40.175940 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:40.176163 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 17:50:40.176253 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:50:41.145143 8397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.144851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.129:34211)
0808 17:50:41.144992 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.145081 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":66,"threads_started":1}
W20260808 17:50:41.145483 7877 heartbeater.cc:644] Failed to heartbeat to 127.28.213.190:38625 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
I20260808 17:50:41.146088 8398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.145859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.131:46705)
0808 17:50:41.145970 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.146028 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":60,"threads_started":1}
W20260808 17:50:41.146302 8294 heartbeater.cc:644] Failed to heartbeat to 127.28.213.190:38625 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
I20260808 17:50:41.146466 8402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.146240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.130:59015)
0808 17:50:41.146358 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.146423 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":56,"threads_started":1}
W20260808 17:50:41.146682 8079 heartbeater.cc:644] Failed to heartbeat to 127.28.213.190:38625 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
I20260808 17:50:41.650202 8403 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eb0483a734342039cd6818b65d8e432)
I20260808 17:50:41.650324 8403 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: false } }
I20260808 17:50:41.650540 8403 leader_election.cc:288] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb0483a734342039cd6818b65d8e432 (127.28.213.190:38625), 367f2cd7cc7a4e6cab215ab04f5370c8 (127.28.213.188:33513)
I20260808 17:50:41.650844 8405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.650640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.0.0.1:40002)
0808 17:50:41.650743 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.650794 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":50,"threads_started":1}
I20260808 17:50:41.650882 8406 raft_consensus.cc:482] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5eb0483a734342039cd6818b65d8e432)
I20260808 17:50:41.651017 8406 raft_consensus.cc:504] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: false } }
W20260808 17:50:41.651084 7270 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
I20260808 17:50:41.651523 8405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.651434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.0.0.1:40010)
0808 17:50:41.651475 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.651497 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 17:50:41.651598 7270 leader_election.cc:334] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eb0483a734342039cd6818b65d8e432 (127.28.213.190:38625): Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
I20260808 17:50:41.651533 8411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.651347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.0.0.1:40006)
0808 17:50:41.651438 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.651495 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78,"thread_start_us":43,"threads_started":1}
I20260808 17:50:41.651777 8406 leader_election.cc:288] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb0483a734342039cd6818b65d8e432 (127.28.213.190:38625), 7ac94f985d6340e983380a2ed849913f (127.28.213.189:43731)
W20260808 17:50:41.651827 7575 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
I20260808 17:50:41.652297 8411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.652188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.0.0.1:40026)
0808 17:50:41.652237 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.652269 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 17:50:41.652419 7575 leader_election.cc:334] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5eb0483a734342039cd6818b65d8e432 (127.28.213.190:38625): Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
I20260808 17:50:41.653839 8407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.650808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37932 (local address 127.28.213.188:33513)
0808 17:50:41.650883 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:41.650885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:41.650894 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:50:41.650920 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:41.650921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:41.650933 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:41.650999 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:41.651176 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.651925 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.653102 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.653544 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.653609 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:41.653619 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:41.653741 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 17:50:41.653779 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56,"thread_start_us":34,"threads_started":1}
I20260808 17:50:41.653842 8404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.650655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:33513 (local address 127.0.0.1:37932)
0808 17:50:41.650742 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.650752 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:41.650806 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:41.651025 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:41.651026 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:41.651028 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:41.651089 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:41.651091 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.652004 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.652004 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:41.653013 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:41.653016 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.653616 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.653617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:41.653682 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:41.653687 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:50:41.653732 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 17:50:41.653777 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76,"thread_start_us":35,"threads_started":1}
I20260808 17:50:41.654122 7605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7ac94f985d6340e983380a2ed849913f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" is_pre_election: true
I20260808 17:50:41.654208 7605 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac94f985d6340e983380a2ed849913f in term 1.
I20260808 17:50:41.654352 7272 leader_election.cc:302] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 367f2cd7cc7a4e6cab215ab04f5370c8, 7ac94f985d6340e983380a2ed849913f; no voters: 5eb0483a734342039cd6818b65d8e432
I20260808 17:50:41.654455 8403 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 17:50:41.654508 8403 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5eb0483a734342039cd6818b65d8e432)
I20260808 17:50:41.654537 8403 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 1 FOLLOWER]: Advancing to term 2
I20260808 17:50:41.654623 8412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.651534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:43731 (local address 127.0.0.1:57846)
0808 17:50:41.651708 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.651719 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:41.651769 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:41.651988 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:41.651989 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:41.651991 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:41.652038 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:41.652040 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.652813 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.652814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:41.653700 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:41.653703 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.654405 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.654407 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:41.654465 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:41.654469 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:41.654519 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 17:50:41.654563 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":54,"threads_started":1}
I20260808 17:50:41.654632 8414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.651672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57846 (local address 127.28.213.189:43731)
0808 17:50:41.651869 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:41.651870 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:41.651877 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:50:41.651895 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:41.651895 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:41.651904 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:41.651965 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:41.652161 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.652739 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.653778 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.654333 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.654398 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:41.654406 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:41.654539 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 17:50:41.654580 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":82,"threads_started":1}
I20260808 17:50:41.654824 7307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7ac94f985d6340e983380a2ed849913f" is_pre_election: true
I20260808 17:50:41.655330 8403 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: false } }
I20260808 17:50:41.655453 8403 leader_election.cc:288] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [CANDIDATE]: Term 2 election: Requested vote from peers 5eb0483a734342039cd6818b65d8e432 (127.28.213.190:38625), 367f2cd7cc7a4e6cab215ab04f5370c8 (127.28.213.188:33513)
I20260808 17:50:41.655459 7307 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 367f2cd7cc7a4e6cab215ab04f5370c8 in current term 2: Already voted for candidate 7ac94f985d6340e983380a2ed849913f in this term.
I20260808 17:50:41.655587 7605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7ac94f985d6340e983380a2ed849913f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8"
I20260808 17:50:41.655668 7605 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 1 FOLLOWER]: Advancing to term 2
I20260808 17:50:41.655717 7573 leader_election.cc:302] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 367f2cd7cc7a4e6cab215ab04f5370c8; no voters: 5eb0483a734342039cd6818b65d8e432, 7ac94f985d6340e983380a2ed849913f
I20260808 17:50:41.655752 8404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.655518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.0.0.1:40034)
0808 17:50:41.655650 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.655730 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260808 17:50:41.656016 8405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.655938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.0.0.1:40044)
0808 17:50:41.655970 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.655998 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260808 17:50:41.656081 7270 leader_election.cc:334] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5eb0483a734342039cd6818b65d8e432 (127.28.213.190:38625): Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
I20260808 17:50:41.656427 7605 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac94f985d6340e983380a2ed849913f in term 2.
I20260808 17:50:41.656497 8406 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:50:41.656572 7272 leader_election.cc:302] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 367f2cd7cc7a4e6cab215ab04f5370c8, 7ac94f985d6340e983380a2ed849913f; no voters: 5eb0483a734342039cd6818b65d8e432
I20260808 17:50:41.656672 8403 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 2 FOLLOWER]: Leader election won for term 2
I20260808 17:50:41.656798 8403 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [term 2 LEADER]: Becoming Leader. State: Replica: 7ac94f985d6340e983380a2ed849913f, State: Running, Role: LEADER
I20260808 17:50:41.656863 8403 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: false } }
I20260808 17:50:41.657177 8417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ac94f985d6340e983380a2ed849913f. Latest consensus state: current_term: 2 leader_uuid: "7ac94f985d6340e983380a2ed849913f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: false } } }
I20260808 17:50:41.657284 8417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:41.657461 8421 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:50:41.657979 8421 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:50:41.658051 8421 catalog_manager.cc:1259] Loaded cluster ID: 4df93004cb3247bea06e50359efa3b7b
I20260808 17:50:41.658082 8421 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:50:41.658228 8421 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:50:41.658296 8421 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: Loaded TSK: 0
I20260808 17:50:41.658435 8421 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:50:41.701010 7293 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57832:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:50:41.702545 7293 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:50:41.703449 8405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.703353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.0.0.1:40054)
0808 17:50:41.703385 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.703417 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260808 17:50:41.703474 7605 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [term 2 FOLLOWER]: Refusing update from remote peer 7ac94f985d6340e983380a2ed849913f: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260808 17:50:41.703687 8417 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [LEADER]: Connected to new peer: Peer: permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260808 17:50:41.703778 8405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.703684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.0.0.1:40062)
0808 17:50:41.703730 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.703758 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 17:50:41.703845 7270 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f -> Peer 5eb0483a734342039cd6818b65d8e432 (127.28.213.190:38625): Couldn't send request to peer 5eb0483a734342039cd6818b65d8e432. Status: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 17:50:41.704249 8406 sys_catalog.cc:455] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ac94f985d6340e983380a2ed849913f. Latest consensus state: current_term: 2 leader_uuid: "7ac94f985d6340e983380a2ed849913f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: false } } }
I20260808 17:50:41.704339 8406 sys_catalog.cc:458] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:50:41.704725 8403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "7ac94f985d6340e983380a2ed849913f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: false } } }
I20260808 17:50:41.704811 8403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:41.704859 8406 sys_catalog.cc:455] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "7ac94f985d6340e983380a2ed849913f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "5eb0483a734342039cd6818b65d8e432" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38625 } } peers { permanent_uuid: "7ac94f985d6340e983380a2ed849913f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 43731 } attrs { promote: false } } peers { permanent_uuid: "367f2cd7cc7a4e6cab215ab04f5370c8" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 33513 } attrs { promote: false } } }
I20260808 17:50:41.704926 8406 sys_catalog.cc:458] T 00000000000000000000000000000000 P 367f2cd7cc7a4e6cab215ab04f5370c8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:50:41.709486 8405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.706403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:33275 (local address 127.0.0.1:53628)
0808 17:50:41.706492 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.706501 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:41.706550 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:41.706800 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:41.706801 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:41.706802 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:41.706849 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:41.706850 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.707582 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.707583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:41.708523 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:41.708525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.709244 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.709245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:41.709320 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:41.709324 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:41.709378 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 17:50:41.709422 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260808 17:50:41.709709 8404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.706462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:42957 (local address 127.0.0.1:55014)
0808 17:50:41.706509 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.706520 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:41.706553 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:41.706745 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:41.706746 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:41.706747 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:41.706788 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:41.706789 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.707795 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.707796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:41.708777 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:41.708778 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.709506 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.709507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:41.709573 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:41.709577 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:41.709609 (+ 32us) client_negotiation.cc:240] Negotiation successful
0808 17:50:41.709648 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":24}
I20260808 17:50:41.709503 8433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.706550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53628 (local address 127.28.213.129:33275)
0808 17:50:41.706658 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:41.706660 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:41.706667 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:50:41.706693 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:41.706694 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:41.706703 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:41.706792 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:41.706919 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.707515 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.708603 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.709145 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.709236 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:41.709246 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:41.709389 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 17:50:41.709431 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":63,"threads_started":1}
I20260808 17:50:41.709996 8432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.706529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55014 (local address 127.28.213.130:42957)
0808 17:50:41.706632 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:41.706633 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:41.706640 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:50:41.706667 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:41.706667 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:41.706676 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:41.706730 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:41.706963 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.707704 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.708838 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.709417 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.709859 (+ 442us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:41.709870 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:41.709889 (+ 19us) server_negotiation.cc:299] Negotiation successful
0808 17:50:41.709929 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":46,"threads_started":1}
I20260808 17:50:41.710099 7764 tablet_service.cc:1467] Processing CreateTablet for tablet beabfafefeb34c9d9046c6ce730f63aa (DEFAULT_TABLE table=test-table [id=5df827b0ba8049d4a7f5c6d17610441f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:41.710151 7980 tablet_service.cc:1467] Processing CreateTablet for tablet beabfafefeb34c9d9046c6ce730f63aa (DEFAULT_TABLE table=test-table [id=5df827b0ba8049d4a7f5c6d17610441f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:41.710224 7764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet beabfafefeb34c9d9046c6ce730f63aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:41.710238 7980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet beabfafefeb34c9d9046c6ce730f63aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:41.710645 8435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.706461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:33753 (local address 127.0.0.1:53100)
0808 17:50:41.706893 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.706902 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:41.706948 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:41.707110 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:41.707111 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:41.707112 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:41.707156 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:41.707158 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.707976 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.707977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:41.709698 (+ 1721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:41.709701 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.710419 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.710420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:41.710490 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:41.710494 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:41.710539 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 17:50:41.710579 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"mutex_wait_us":268,"thread_start_us":62,"threads_started":1}
I20260808 17:50:41.710657 8434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.706664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53100 (local address 127.28.213.131:33753)
0808 17:50:41.706852 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:41.706854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:41.706989 (+ 135us) server_negotiation.cc:407] Connection header received
0808 17:50:41.707015 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:41.707016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:41.707025 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:41.707073 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:41.707230 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.707893 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.709771 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:41.710340 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:41.710419 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:41.710428 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:41.710549 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 17:50:41.710594 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":50,"threads_started":1}
I20260808 17:50:41.711658 8439 tablet_bootstrap.cc:492] T beabfafefeb34c9d9046c6ce730f63aa P 0435c861f1d04d16a2b5b1f07b049cde: Bootstrap starting.
I20260808 17:50:41.711694 8193 tablet_service.cc:1467] Processing CreateTablet for tablet beabfafefeb34c9d9046c6ce730f63aa (DEFAULT_TABLE table=test-table [id=5df827b0ba8049d4a7f5c6d17610441f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:41.711810 8193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet beabfafefeb34c9d9046c6ce730f63aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:41.712049 8439 tablet_bootstrap.cc:654] T beabfafefeb34c9d9046c6ce730f63aa P 0435c861f1d04d16a2b5b1f07b049cde: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:41.712282 8436 tablet_bootstrap.cc:492] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377: Bootstrap starting.
I20260808 17:50:41.712563 8436 tablet_bootstrap.cc:654] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:41.712647 8439 tablet_bootstrap.cc:492] T beabfafefeb34c9d9046c6ce730f63aa P 0435c861f1d04d16a2b5b1f07b049cde: No bootstrap required, opened a new log
I20260808 17:50:41.712702 8439 ts_tablet_manager.cc:1397] T beabfafefeb34c9d9046c6ce730f63aa P 0435c861f1d04d16a2b5b1f07b049cde: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:41.712811 8439 raft_consensus.cc:348] T beabfafefeb34c9d9046c6ce730f63aa P 0435c861f1d04d16a2b5b1f07b049cde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } } peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } }
I20260808 17:50:41.712882 8439 raft_consensus.cc:374] T beabfafefeb34c9d9046c6ce730f63aa P 0435c861f1d04d16a2b5b1f07b049cde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:41.712903 8439 raft_consensus.cc:729] T beabfafefeb34c9d9046c6ce730f63aa P 0435c861f1d04d16a2b5b1f07b049cde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0435c861f1d04d16a2b5b1f07b049cde, State: Initialized, Role: FOLLOWER
I20260808 17:50:41.712965 8439 consensus_queue.cc:260] T beabfafefeb34c9d9046c6ce730f63aa P 0435c861f1d04d16a2b5b1f07b049cde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } } peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } }
I20260808 17:50:41.713114 8439 ts_tablet_manager.cc:1428] T beabfafefeb34c9d9046c6ce730f63aa P 0435c861f1d04d16a2b5b1f07b049cde: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:41.713173 8445 tablet_bootstrap.cc:492] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922: Bootstrap starting.
I20260808 17:50:41.713358 8436 tablet_bootstrap.cc:492] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377: No bootstrap required, opened a new log
I20260808 17:50:41.713404 8436 ts_tablet_manager.cc:1397] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:41.713498 8436 raft_consensus.cc:348] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } } peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } }
I20260808 17:50:41.713521 8446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.713304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.129:46067)
0808 17:50:41.713450 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.713488 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":82,"threads_started":1}
I20260808 17:50:41.713541 8436 raft_consensus.cc:374] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:41.713553 8436 raft_consensus.cc:729] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93741712302c47528a0c85bd02d5b377, State: Initialized, Role: FOLLOWER
I20260808 17:50:41.713563 8445 tablet_bootstrap.cc:654] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:41.713585 8436 consensus_queue.cc:260] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } } peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } }
I20260808 17:50:41.713730 8436 ts_tablet_manager.cc:1428] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:41.714107 8445 tablet_bootstrap.cc:492] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922: No bootstrap required, opened a new log
I20260808 17:50:41.714157 8445 ts_tablet_manager.cc:1397] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:41.714270 8452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.714071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.130:36917)
0808 17:50:41.714192 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.714229 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":82,"threads_started":1}
I20260808 17:50:41.714268 8445 raft_consensus.cc:348] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } } peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } }
I20260808 17:50:41.714323 8445 raft_consensus.cc:374] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:41.714340 8445 raft_consensus.cc:729] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49cc6e8f7b8348a0ac937675ff758922, State: Initialized, Role: FOLLOWER
I20260808 17:50:41.714382 8445 consensus_queue.cc:260] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } } peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } }
I20260808 17:50:41.714514 8445 ts_tablet_manager.cc:1428] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:41.714946 8456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.714737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.131:39247)
0808 17:50:41.714870 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.714914 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":80,"threads_started":1}
I20260808 17:50:41.715508 8446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.715432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.129:35499)
0808 17:50:41.715463 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.715487 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260808 17:50:41.715639 8452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:41.715555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.130:56913)
0808 17:50:41.715592 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:41.715614 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 17:50:41.715737 7878 heartbeater.cc:503] Master 127.28.213.189:43731 was elected leader, sending a full tablet report...
W20260808 17:50:41.910059 7881 tablet.cc:2369] T beabfafefeb34c9d9046c6ce730f63aa P 0435c861f1d04d16a2b5b1f07b049cde: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:50:41.933246 8298 tablet.cc:2369] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:50:42.014595 8447 raft_consensus.cc:482] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:50:42.014700 8447 raft_consensus.cc:504] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } } peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } }
I20260808 17:50:42.015098 8447 leader_election.cc:288] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0435c861f1d04d16a2b5b1f07b049cde (127.28.213.129:33275), 49cc6e8f7b8348a0ac937675ff758922 (127.28.213.131:33753)
I20260808 17:50:42.017796 8433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:42.015370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:55061 (local address 127.28.213.129:33275)
0808 17:50:42.015426 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:42.015427 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:42.015438 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:50:42.015468 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:42.015469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:42.015478 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:42.015527 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:42.015660 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:42.016145 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:42.017044 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:42.017502 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:42.017564 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:42.017575 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:42.017685 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 17:50:42.017738 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 17:50:42.017794 8452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:42.015263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:33275 (local address 127.28.213.130:55061)
0808 17:50:42.015329 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:42.015343 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:42.015415 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:42.015535 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:42.015536 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:42.015538 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:42.015606 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:42.015608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:42.016213 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:42.016213 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:42.016962 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:42.016964 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:42.017567 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:42.017568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:42.017625 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:42.017628 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:50:42.017673 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 17:50:42.017711 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 17:50:42.017889 8457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:42.015263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:33753 (local address 127.28.213.130:46873)
0808 17:50:42.015511 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:42.015520 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:42.015590 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:42.015717 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:42.015717 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:42.015719 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:42.015780 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:42.015782 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:42.016385 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:42.016386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:42.017064 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:42.017066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:42.017604 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:42.017605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:42.017693 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:42.017697 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:42.017773 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 17:50:42.017812 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":56,"thread_start_us":131,"threads_started":1}
I20260808 17:50:42.018044 7801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beabfafefeb34c9d9046c6ce730f63aa" candidate_uuid: "93741712302c47528a0c85bd02d5b377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0435c861f1d04d16a2b5b1f07b049cde" is_pre_election: true
I20260808 17:50:42.018134 7801 raft_consensus.cc:2454] T beabfafefeb34c9d9046c6ce730f63aa P 0435c861f1d04d16a2b5b1f07b049cde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93741712302c47528a0c85bd02d5b377 in term 0.
I20260808 17:50:42.018242 8434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:42.015323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:46873 (local address 127.28.213.131:33753)
0808 17:50:42.015370 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:42.015372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:42.015590 (+ 218us) server_negotiation.cc:407] Connection header received
0808 17:50:42.015654 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:42.015655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:42.015665 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:42.015706 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:42.015838 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:42.016312 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:42.017147 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:42.017536 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:42.017597 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:42.017607 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:42.017793 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 17:50:42.017830 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:50:42.018350 7911 leader_election.cc:302] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0435c861f1d04d16a2b5b1f07b049cde, 93741712302c47528a0c85bd02d5b377; no voters:
I20260808 17:50:42.018479 8447 raft_consensus.cc:2781] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:50:42.018435 8219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beabfafefeb34c9d9046c6ce730f63aa" candidate_uuid: "93741712302c47528a0c85bd02d5b377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49cc6e8f7b8348a0ac937675ff758922" is_pre_election: true
I20260808 17:50:42.018517 8447 raft_consensus.cc:482] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:50:42.018535 8447 raft_consensus.cc:3037] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:42.018561 8219 raft_consensus.cc:2454] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93741712302c47528a0c85bd02d5b377 in term 0.
I20260808 17:50:42.019282 8447 raft_consensus.cc:504] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } } peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } }
I20260808 17:50:42.019402 8447 leader_election.cc:288] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [CANDIDATE]: Term 1 election: Requested vote from peers 0435c861f1d04d16a2b5b1f07b049cde (127.28.213.129:33275), 49cc6e8f7b8348a0ac937675ff758922 (127.28.213.131:33753)
I20260808 17:50:42.019553 7801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beabfafefeb34c9d9046c6ce730f63aa" candidate_uuid: "93741712302c47528a0c85bd02d5b377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0435c861f1d04d16a2b5b1f07b049cde"
I20260808 17:50:42.019634 7801 raft_consensus.cc:3037] T beabfafefeb34c9d9046c6ce730f63aa P 0435c861f1d04d16a2b5b1f07b049cde [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:42.019618 8219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beabfafefeb34c9d9046c6ce730f63aa" candidate_uuid: "93741712302c47528a0c85bd02d5b377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49cc6e8f7b8348a0ac937675ff758922"
I20260808 17:50:42.019676 8219 raft_consensus.cc:3037] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:42.020366 7801 raft_consensus.cc:2454] T beabfafefeb34c9d9046c6ce730f63aa P 0435c861f1d04d16a2b5b1f07b049cde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93741712302c47528a0c85bd02d5b377 in term 1.
I20260808 17:50:42.020459 8219 raft_consensus.cc:2454] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93741712302c47528a0c85bd02d5b377 in term 1.
I20260808 17:50:42.020534 7911 leader_election.cc:302] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0435c861f1d04d16a2b5b1f07b049cde, 93741712302c47528a0c85bd02d5b377; no voters:
I20260808 17:50:42.020637 8447 raft_consensus.cc:2781] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:42.020792 8447 raft_consensus.cc:686] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [term 1 LEADER]: Becoming Leader. State: Replica: 93741712302c47528a0c85bd02d5b377, State: Running, Role: LEADER
I20260808 17:50:42.020874 8080 heartbeater.cc:503] Master 127.28.213.189:43731 was elected leader, sending a full tablet report...
I20260808 17:50:42.020901 8447 consensus_queue.cc:237] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } } peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } }
I20260808 17:50:42.021081 8457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:42.020993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.130:54663)
0808 17:50:42.021026 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:42.021059 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260808 17:50:42.021615 7293 catalog_manager.cc:5495] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93741712302c47528a0c85bd02d5b377 (127.28.213.130). New cstate: current_term: 1 leader_uuid: "93741712302c47528a0c85bd02d5b377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93741712302c47528a0c85bd02d5b377" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42957 } health_report { overall_health: HEALTHY } } }
I20260808 17:50:42.059525 8432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:42.057255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55030 (local address 127.28.213.130:42957)
0808 17:50:42.057302 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:42.057304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:42.057312 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:42.057344 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:42.057345 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:42.057363 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:42.057425 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:42.057536 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:42.058103 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:42.058801 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:42.059027 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:42.059080 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:42.059224 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:42.059324 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:42.059385 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:42.059442 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 17:50:42.059462 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:50:42.060411 7801 raft_consensus.cc:1261] T beabfafefeb34c9d9046c6ce730f63aa P 0435c861f1d04d16a2b5b1f07b049cde [term 1 FOLLOWER]: Refusing update from remote peer 93741712302c47528a0c85bd02d5b377: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:42.060527 8219 raft_consensus.cc:1261] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922 [term 1 FOLLOWER]: Refusing update from remote peer 93741712302c47528a0c85bd02d5b377: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:42.060644 8447 consensus_queue.cc:1035] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0435c861f1d04d16a2b5b1f07b049cde" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 33275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:42.060792 8461 consensus_queue.cc:1035] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49cc6e8f7b8348a0ac937675ff758922" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:42.061282 8295 heartbeater.cc:503] Master 127.28.213.189:43731 was elected leader, sending a full tablet report...
I20260808 17:50:42.061328 8446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:42.061235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.129:36669)
0808 17:50:42.061275 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:42.061301 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260808 17:50:42.061546 8456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:42.061452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.131:58531)
0808 17:50:42.061494 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:42.061520 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 17:50:42.062282 8465 mvcc.cc:205] Tried to move back new op lower bound from 7316322066677755904 to 7316322066518167552. Current Snapshot: MvccSnapshot[applied={T|T < 7316322066677755904}]
I20260808 17:50:42.062709 8457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:42.062628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.130:57533)
0808 17:50:42.062658 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:42.062684 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260808 17:50:42.063434 8456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:42.063350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.131:43917)
0808 17:50:42.063383 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:42.063415 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260808 17:50:42.063431 8446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:42.063350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.129:49265)
0808 17:50:42.063383 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:42.063405 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260808 17:50:42.064190 8457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:42.064113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38625 (local address 127.28.213.130:56743)
0808 17:50:42.064142 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:42.064167 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
I20260808 17:50:42.064390 7292 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:42.064492 7292 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:42.065768 7292 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7ac94f985d6340e983380a2ed849913f: Sending DeleteTablet for 3 replicas of tablet beabfafefeb34c9d9046c6ce730f63aa
I20260808 17:50:42.066075 7764 tablet_service.cc:1514] Processing DeleteTablet for tablet beabfafefeb34c9d9046c6ce730f63aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:42 UTC) from {username='oryx', principal='oryx/127.28.213.189@KRBTEST.COM'} at 127.0.0.1:53628
I20260808 17:50:42.066102 8193 tablet_service.cc:1514] Processing DeleteTablet for tablet beabfafefeb34c9d9046c6ce730f63aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:42 UTC) from {username='oryx', principal='oryx/127.28.213.189@KRBTEST.COM'} at 127.0.0.1:53100
I20260808 17:50:42.066112 7980 tablet_service.cc:1514] Processing DeleteTablet for tablet beabfafefeb34c9d9046c6ce730f63aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:42 UTC) from {username='oryx', principal='oryx/127.28.213.189@KRBTEST.COM'} at 127.0.0.1:55014
I20260808 17:50:42.066426 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 7678
I20260808 17:50:42.073778 8479 tablet_replica.cc:330] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922: stopping tablet replica
I20260808 17:50:42.073848 8479 raft_consensus.cc:2229] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:42.073886 8479 raft_consensus.cc:2258] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:42.074128 8480 tablet_replica.cc:330] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377: stopping tablet replica
I20260808 17:50:42.074146 8479 ts_tablet_manager.cc:1905] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:42.074175 8480 raft_consensus.cc:2229] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:50:42.074245 8480 raft_consensus.cc:2258] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:42.075862 8479 ts_tablet_manager.cc:1918] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:50:42.075911 8479 log.cc:1196] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/beabfafefeb34c9d9046c6ce730f63aa
I20260808 17:50:42.076107 8480 ts_tablet_manager.cc:1905] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:42.076145 8479 ts_tablet_manager.cc:1939] T beabfafefeb34c9d9046c6ce730f63aa P 49cc6e8f7b8348a0ac937675ff758922: Deleting consensus metadata
I20260808 17:50:42.076494 7272 catalog_manager.cc:4841] TS 49cc6e8f7b8348a0ac937675ff758922 (127.28.213.131:33753): tablet beabfafefeb34c9d9046c6ce730f63aa (table test-table [id=5df827b0ba8049d4a7f5c6d17610441f]) successfully deleted
I20260808 17:50:42.077652 8480 ts_tablet_manager.cc:1918] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:50:42.077710 8480 log.cc:1196] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/beabfafefeb34c9d9046c6ce730f63aa
I20260808 17:50:42.077909 8480 ts_tablet_manager.cc:1939] T beabfafefeb34c9d9046c6ce730f63aa P 93741712302c47528a0c85bd02d5b377: Deleting consensus metadata
I20260808 17:50:42.078248 7270 catalog_manager.cc:4841] TS 93741712302c47528a0c85bd02d5b377 (127.28.213.130:42957): tablet beabfafefeb34c9d9046c6ce730f63aa (table test-table [id=5df827b0ba8049d4a7f5c6d17610441f]) successfully deleted
W20260808 17:50:42.081141 8435 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:42.080929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:33275 (local address 127.0.0.1:53636)
0808 17:50:42.080986 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:42.080998 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:42.081049 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:42.081096 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.129:33275: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 17:50:42.081326 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 7886
W20260808 17:50:42.081339 7269 catalog_manager.cc:4584] TS 0435c861f1d04d16a2b5b1f07b049cde (127.28.213.129:33275): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet beabfafefeb34c9d9046c6ce730f63aa: Network error: Client connection negotiation failed: client connection to 127.28.213.129:33275: BlockingWrite error: write error: Connection reset by peer (error 104)
I20260808 17:50:42.095652 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 8090
I20260808 17:50:42.107358 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 7066
I20260808 17:50:42.114996 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 7379
2026-08-08T17:50:42Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5056 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:50:42 dist-test-slave-bndk krb5kdc[8483](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:50:42 dist-test-slave-bndk krb5kdc[8483](info): set up 2 sockets
Aug 08 17:50:42 dist-test-slave-bndk krb5kdc[8483](info): commencing operation
krb5kdc: starting...
W20260808 17:50:43.233155 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.094s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:50:43 dist-test-slave-bndk krb5kdc[8483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:50:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:50:43Z Disabled control of system clock
WARNING: no policy specified for oryx/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.190.keytab.
Entry for principal oryx/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.190.keytab.
I20260808 17:50:43.340574 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:35461
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.190.keytab
--principal=oryx/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:35461
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:43.419275 8503 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:43.419453 8503 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:43.419473 8503 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:43.420588 8503 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:43.420626 8503 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 17:50:43.420639 8503 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:43.420662 8503 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:43.420686 8503 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:43.420706 8503 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:50:43.422209 8503 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:35461
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.190.keytab
--principal=oryx/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:35461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8503
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:43.422428 8503 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:43.422629 8503 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:43.427187 8517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:43.427210 8514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:43.427244 8503 server_base.cc:1034] running on GCE node
W20260808 17:50:43.427187 8520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:43.427567 8503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:43.427831 8503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:43.428973 8503 hybrid_clock.cc:648] HybridClock initialized: now 1786211443428962 us; error 31 us; skew 500 ppm
Aug 08 17:50:43 dist-test-slave-bndk krb5kdc[8483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211443, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:43.434748 8503 init.cc:377] Logged in from keytab as oryx/127.28.213.190@KRBTEST.COM (short username oryx)
I20260808 17:50:43.435168 8503 webserver.cc:460] Webserver started at http://127.28.213.190:36235/ using document root <none> and password file <none>
I20260808 17:50:43.435380 8503 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:43.435436 8503 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:43.435556 8503 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:43.436515 8503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "f829a740d0fa42f489e3683acc660f23"
format_stamp: "Formatted at 2026-08-08 17:50:43 on dist-test-slave-bndk"
server_key: "a39a0c5057670645a7aab40991550992"
server_key_iv: "23d7b89ddfcc935c253d7d9f3402fb81"
server_key_version: "encryptionkey@0"
I20260808 17:50:43.436833 8503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "f829a740d0fa42f489e3683acc660f23"
format_stamp: "Formatted at 2026-08-08 17:50:43 on dist-test-slave-bndk"
server_key: "a39a0c5057670645a7aab40991550992"
server_key_iv: "23d7b89ddfcc935c253d7d9f3402fb81"
server_key_version: "encryptionkey@0"
I20260808 17:50:43.438073 8503 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:50:43.438699 8531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:43.438843 8503 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:43.438925 8503 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "f829a740d0fa42f489e3683acc660f23"
format_stamp: "Formatted at 2026-08-08 17:50:43 on dist-test-slave-bndk"
server_key: "a39a0c5057670645a7aab40991550992"
server_key_iv: "23d7b89ddfcc935c253d7d9f3402fb81"
server_key_version: "encryptionkey@0"
I20260808 17:50:43.438983 8503 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:43.451212 8503 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:43.452728 8503 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:43.452852 8503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:43.457341 8503 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:35461
I20260808 17:50:43.457374 8630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:35461 every 8 connection(s)
I20260808 17:50:43.457670 8503 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:50:43.458288 8631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:43.460366 8631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23: Bootstrap starting.
I20260808 17:50:43.460892 8631 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:43.461151 8631 log.cc:824] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:43.461771 8631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23: No bootstrap required, opened a new log
I20260808 17:50:43.463692 8631 raft_consensus.cc:348] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f829a740d0fa42f489e3683acc660f23" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35461 } }
I20260808 17:50:43.463821 8631 raft_consensus.cc:374] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:43.463850 8631 raft_consensus.cc:729] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f829a740d0fa42f489e3683acc660f23, State: Initialized, Role: FOLLOWER
I20260808 17:50:43.463969 8631 consensus_queue.cc:260] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f829a740d0fa42f489e3683acc660f23" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35461 } }
I20260808 17:50:43.464046 8631 raft_consensus.cc:388] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:50:43.464073 8631 raft_consensus.cc:482] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:50:43.464104 8631 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:43.464589 8631 raft_consensus.cc:504] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f829a740d0fa42f489e3683acc660f23" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35461 } }
I20260808 17:50:43.464692 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 8503
I20260808 17:50:43.464745 8631 leader_election.cc:302] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f829a740d0fa42f489e3683acc660f23; no voters:
I20260808 17:50:43.464781 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:50:43.464954 8631 leader_election.cc:288] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:50:43.464987 29526 external_mini_cluster.cc:1428] Setting key 89b0267a7d4d2c6f8d809e23bb7f23b8
I20260808 17:50:43.465000 8639 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:43.465173 8639 raft_consensus.cc:686] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23 [term 1 LEADER]: Becoming Leader. State: Replica: f829a740d0fa42f489e3683acc660f23, State: Running, Role: LEADER
I20260808 17:50:43.465238 8631 sys_catalog.cc:564] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:43.465353 8639 consensus_queue.cc:237] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f829a740d0fa42f489e3683acc660f23" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35461 } }
I20260808 17:50:43.465976 8640 sys_catalog.cc:455] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f829a740d0fa42f489e3683acc660f23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f829a740d0fa42f489e3683acc660f23" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35461 } } }
I20260808 17:50:43.466066 8640 sys_catalog.cc:458] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:43.466228 8641 sys_catalog.cc:455] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f829a740d0fa42f489e3683acc660f23. Latest consensus state: current_term: 1 leader_uuid: "f829a740d0fa42f489e3683acc660f23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f829a740d0fa42f489e3683acc660f23" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35461 } } }
I20260808 17:50:43.466288 8641 sys_catalog.cc:458] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23 [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:43.466270 8660 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:50:43.466960 8660 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:50:43.468370 8660 catalog_manager.cc:1347] Generated new cluster ID: 95b972f4043c4eed994837f47da8ce26
I20260808 17:50:43.468423 8660 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:50:43 dist-test-slave-bndk krb5kdc[8483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM
I20260808 17:50:43.476707 8649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.465642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53976 (local address 127.28.213.190:35461)
0808 17:50:43.465785 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:43.465795 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:43.465862 (+ 67us) server_negotiation.cc:407] Connection header received
0808 17:50:43.466379 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:43.466387 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:43.466461 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:43.467484 (+ 1023us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:43.467576 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.468898 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.469966 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.470601 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.470711 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.473353 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:43.473364 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:43.473365 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:43.473376 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:43.475166 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:43.475566 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:43.475569 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:43.475570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:43.475668 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:43.475857 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:43.475858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:43.475859 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:43.476125 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:43.476276 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:43.476364 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 17:50:43.476491 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":78,"threads_started":1}
I20260808 17:50:43.477736 8660 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:50:43.478210 8660 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:50:43.490495 8660 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23: Generated new TSK 0
I20260808 17:50:43.490633 8660 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.129.keytab.
Entry for principal oryx/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.129.keytab.
I20260808 17:50:43.515718 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:35461
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.129.keytab
--principal=oryx/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:43.595148 8678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:43.595335 8678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:43.595367 8678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:43.596469 8678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:43.596506 8678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:43.596532 8678 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 17:50:43.596556 8678 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:50:43.598065 8678 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.129.keytab
--principal=oryx/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.213.190:35461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8678
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:43.598291 8678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:43.598489 8678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:43.603036 8683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:43.603051 8685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:43.603116 8687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:43.603176 8678 server_base.cc:1034] running on GCE node
I20260808 17:50:43.603461 8678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:43.603693 8678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:43.604833 8678 hybrid_clock.cc:648] HybridClock initialized: now 1786211443604820 us; error 28 us; skew 500 ppm
Aug 08 17:50:43 dist-test-slave-bndk krb5kdc[8483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211443, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:43.607270 8678 init.cc:377] Logged in from keytab as oryx/127.28.213.129@KRBTEST.COM (short username oryx)
I20260808 17:50:43.607640 8678 webserver.cc:460] Webserver started at http://127.28.213.129:43183/ using document root <none> and password file <none>
I20260808 17:50:43.607825 8678 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:43.607862 8678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:43.607959 8678 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:43.608892 8678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "9387bfa05a614e9c91db94802a928ba2"
format_stamp: "Formatted at 2026-08-08 17:50:43 on dist-test-slave-bndk"
server_key: "392255f07b00f90644dbb6ae1fd1f6a8"
server_key_iv: "cb38ca2af55153d84802841adadadcae"
server_key_version: "encryptionkey@0"
I20260808 17:50:43.609351 8678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "9387bfa05a614e9c91db94802a928ba2"
format_stamp: "Formatted at 2026-08-08 17:50:43 on dist-test-slave-bndk"
server_key: "392255f07b00f90644dbb6ae1fd1f6a8"
server_key_iv: "cb38ca2af55153d84802841adadadcae"
server_key_version: "encryptionkey@0"
I20260808 17:50:43.610993 8678 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:43.611832 8698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:43.612035 8678 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:43.612136 8678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "9387bfa05a614e9c91db94802a928ba2"
format_stamp: "Formatted at 2026-08-08 17:50:43 on dist-test-slave-bndk"
server_key: "392255f07b00f90644dbb6ae1fd1f6a8"
server_key_iv: "cb38ca2af55153d84802841adadadcae"
server_key_version: "encryptionkey@0"
I20260808 17:50:43.612210 8678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:43.639724 8678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:43.641750 8678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:43.641856 8678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:43.642289 8678 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:43.642333 8678 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:43.642352 8678 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:43.642364 8678 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 17:50:43 dist-test-slave-bndk krb5kdc[8483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211443, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM
I20260808 17:50:43.648965 8678 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:37049
I20260808 17:50:43.649130 8873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:37049 every 8 connection(s)
I20260808 17:50:43.649374 8678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:50:43.650488 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 8678
I20260808 17:50:43.650584 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:50:43.650787 29526 external_mini_cluster.cc:1428] Setting key 13087fda512ad32c6ef19c8435fbdc82
I20260808 17:50:43.651340 8649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.642688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:40353 (local address 127.28.213.190:35461)
0808 17:50:43.642747 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:43.642750 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:43.642980 (+ 230us) server_negotiation.cc:407] Connection header received
0808 17:50:43.643613 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:43.643615 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:43.643628 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:43.643682 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:43.644485 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.645288 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.646256 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.646481 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.646537 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.648574 (+ 2037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:43.648576 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:43.648576 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:43.648583 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:43.650032 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:43.650451 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:43.650452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:43.650453 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:43.650507 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:43.650759 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:43.650760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:43.650760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:43.650882 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:43.650940 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:43.651193 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 17:50:43.651263 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:50:43.651511 8709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.642680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:35461 (local address 127.28.213.129:40353)
0808 17:50:43.642845 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:43.642893 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:43.643510 (+ 617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:43.643758 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:43.643762 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:43.644106 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:43.644378 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:43.644385 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.645382 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.645384 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:43.646174 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:43.646177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.646570 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.646571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:43.646680 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.647203 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:43.647211 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:43.648488 (+ 1277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:43.650098 (+ 1610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:43.650101 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:43.650102 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:43.650364 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:43.650566 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:43.650566 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:43.650567 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:43.650697 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:43.650937 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:43.650944 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:43.651069 (+ 125us) client_negotiation.cc:769] Sending connection context
0808 17:50:43.651176 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 17:50:43.651340 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":76,"threads_started":1}
I20260808 17:50:43.653175 8875 heartbeater.cc:347] Connected to a master server at 127.28.213.190:35461
I20260808 17:50:43.653293 8875 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:43.653470 8875 heartbeater.cc:511] Master 127.28.213.190:35461 requested a full tablet report, sending...
I20260808 17:50:43.653995 8556 ts_manager.cc:194] Registered new tserver with Master: 9387bfa05a614e9c91db94802a928ba2 (127.28.213.129:37049)
I20260808 17:50:43.654654 8556 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:40353
I20260808 17:50:43.657974 8649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.652903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:58891 (local address 127.28.213.190:35461)
0808 17:50:43.652961 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:43.652963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:43.653003 (+ 40us) server_negotiation.cc:407] Connection header received
0808 17:50:43.653068 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:43.653069 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:43.653078 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:43.653117 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:43.653500 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.654018 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.654711 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.654964 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.655029 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.655869 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:43.655870 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:43.655870 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:43.655876 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:43.656995 (+ 1119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:43.657303 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:43.657304 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:43.657304 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:43.657356 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:43.657521 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:43.657521 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:43.657522 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:43.657620 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:43.657673 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:43.657814 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 17:50:43.657883 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 17:50:43.657981 8885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.652831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:35461 (local address 127.28.213.129:58891)
0808 17:50:43.652948 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:43.652958 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:43.653016 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:43.653129 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:43.653130 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:43.653368 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:43.653430 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:43.653432 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.654109 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.654110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:43.654636 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:43.654637 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.655146 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.655147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:43.655207 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.655550 (+ 343us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:43.655553 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:43.655791 (+ 238us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:43.657067 (+ 1276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:43.657067 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:43.657068 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:43.657248 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:43.657416 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:43.657417 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:43.657417 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:43.657472 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:43.657673 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:43.657673 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:43.657714 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 17:50:43.657785 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 17:50:43.657879 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":61,"threads_started":1}
WARNING: no policy specified for oryx/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.130.keytab.
Entry for principal oryx/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.130.keytab.
I20260808 17:50:43.675330 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:35461
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.130.keytab
--principal=oryx/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:43.755697 8889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:43.755883 8889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:43.755913 8889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:43.756982 8889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:43.757016 8889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:43.757033 8889 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 17:50:43.757052 8889 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:50:43.758530 8889 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.130.keytab
--principal=oryx/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.213.190:35461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:43.758702 8889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:43.758872 8889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:43.763350 8905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:43.763387 8901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:43.763561 8889 server_base.cc:1034] running on GCE node
W20260808 17:50:43.763635 8902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:43.763814 8889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:43.764035 8889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:43.765173 8889 hybrid_clock.cc:648] HybridClock initialized: now 1786211443765159 us; error 35 us; skew 500 ppm
Aug 08 17:50:43 dist-test-slave-bndk krb5kdc[8483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211443, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:43.767593 8889 init.cc:377] Logged in from keytab as oryx/127.28.213.130@KRBTEST.COM (short username oryx)
I20260808 17:50:43.767972 8889 webserver.cc:460] Webserver started at http://127.28.213.130:40867/ using document root <none> and password file <none>
I20260808 17:50:43.768154 8889 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:43.768195 8889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:43.768311 8889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:43.769349 8889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "a467bd081fee4d298f469f62c8d4cd67"
format_stamp: "Formatted at 2026-08-08 17:50:43 on dist-test-slave-bndk"
server_key: "1bdd2feab172d2836a0b5a82b369b17f"
server_key_iv: "ab16899d0e89cb01d3e9818399eb1089"
server_key_version: "encryptionkey@0"
I20260808 17:50:43.769665 8889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "a467bd081fee4d298f469f62c8d4cd67"
format_stamp: "Formatted at 2026-08-08 17:50:43 on dist-test-slave-bndk"
server_key: "1bdd2feab172d2836a0b5a82b369b17f"
server_key_iv: "ab16899d0e89cb01d3e9818399eb1089"
server_key_version: "encryptionkey@0"
I20260808 17:50:43.770830 8889 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:43.771452 8916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:43.771593 8889 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:43.771674 8889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "a467bd081fee4d298f469f62c8d4cd67"
format_stamp: "Formatted at 2026-08-08 17:50:43 on dist-test-slave-bndk"
server_key: "1bdd2feab172d2836a0b5a82b369b17f"
server_key_iv: "ab16899d0e89cb01d3e9818399eb1089"
server_key_version: "encryptionkey@0"
I20260808 17:50:43.771726 8889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:43.778743 8889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:43.780334 8889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:43.780442 8889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:43.780849 8889 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:43.780889 8889 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:43.780915 8889 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:43.780941 8889 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:43.787058 8889 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:33437
Aug 08 17:50:43 dist-test-slave-bndk krb5kdc[8483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211443, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM
I20260808 17:50:43.787089 9105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:33437 every 8 connection(s)
I20260808 17:50:43.787417 8889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:50:43.789507 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 8889
I20260808 17:50:43.789602 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:50:43.789778 29526 external_mini_cluster.cc:1428] Setting key 31f705c09b58f8a9402170a899439b55
I20260808 17:50:43.789983 8932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.781252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:35461 (local address 127.28.213.130:46273)
0808 17:50:43.781385 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:43.781423 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:43.781833 (+ 410us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:43.782052 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:43.782055 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:43.782338 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:43.782587 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:43.782593 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.783533 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.783534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:43.784761 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:43.784764 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.785262 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.785263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:43.785402 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.785850 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:43.785860 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:43.787518 (+ 1658us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:43.788774 (+ 1256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:43.788779 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:43.788781 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:43.788986 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:43.789131 (+ 145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:43.789131 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:43.789132 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:43.789239 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:43.789474 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:43.789478 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:43.789580 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 17:50:43.789665 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 17:50:43.789789 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":70,"threads_started":1}
I20260808 17:50:43.790282 8649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.781285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:46273 (local address 127.28.213.190:35461)
0808 17:50:43.781360 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:43.781362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:43.781497 (+ 135us) server_negotiation.cc:407] Connection header received
0808 17:50:43.781915 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:43.781917 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:43.781930 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:43.782007 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:43.782686 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.783421 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.784853 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.785143 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.785233 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.787610 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:43.787611 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:43.787612 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:43.787621 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:43.788710 (+ 1089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:43.789043 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:43.789044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:43.789044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:43.789088 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:43.789287 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:43.789288 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:43.789288 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:43.789409 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:43.789478 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:43.790135 (+ 657us) server_negotiation.cc:299] Negotiation successful
0808 17:50:43.790220 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 17:50:43.790617 9106 heartbeater.cc:347] Connected to a master server at 127.28.213.190:35461
I20260808 17:50:43.790697 9106 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:43.790859 9106 heartbeater.cc:511] Master 127.28.213.190:35461 requested a full tablet report, sending...
I20260808 17:50:43.791206 8557 ts_manager.cc:194] Registered new tserver with Master: a467bd081fee4d298f469f62c8d4cd67 (127.28.213.130:33437)
I20260808 17:50:43.791584 8557 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:46273
I20260808 17:50:43.797463 8649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.792563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:53621 (local address 127.28.213.190:35461)
0808 17:50:43.792599 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:43.792601 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:43.792725 (+ 124us) server_negotiation.cc:407] Connection header received
0808 17:50:43.792776 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:43.792777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:43.792787 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:43.792832 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:43.793118 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.793613 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.794247 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.794436 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.794487 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.795265 (+ 778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:43.795267 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:43.795267 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:43.795274 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:43.796441 (+ 1167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:43.796746 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:43.796747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:43.796747 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:43.796800 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:43.796957 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:43.796957 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:43.796958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:43.797091 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:43.797148 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:43.797309 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 17:50:43.797380 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 17:50:43.797485 9117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.792500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:35461 (local address 127.28.213.130:53621)
0808 17:50:43.792662 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:43.792671 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:43.792725 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:43.792834 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:43.792834 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:43.792993 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:43.793052 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:43.793053 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.793697 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.793698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:43.794179 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:43.794180 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.794493 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.794494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:43.794554 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.794906 (+ 352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:43.794910 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:43.795187 (+ 277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:43.796516 (+ 1329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:43.796517 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:43.796517 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:43.796685 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:43.796851 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:43.796852 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:43.796852 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:43.796907 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:43.797151 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:43.797152 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:43.797207 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 17:50:43.797287 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 17:50:43.797382 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":72,"threads_started":1}
WARNING: no policy specified for oryx/127.28.213.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.131.keytab.
Entry for principal oryx/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.131.keytab.
I20260808 17:50:43.812772 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:35461
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.131.keytab
--principal=oryx/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:43.890867 9122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:43.891043 9122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:43.891064 9122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:43.892161 9122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:43.892200 9122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:43.892220 9122 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 17:50:43.892239 9122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:50:43.893689 9122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.131.keytab
--principal=oryx/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.213.190:35461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:43.893872 9122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:43.894033 9122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:43.898612 9133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:43.898744 9122 server_base.cc:1034] running on GCE node
W20260808 17:50:43.898629 9129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:43.898644 9130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:43.898998 9122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:43.899216 9122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:43.900357 9122 hybrid_clock.cc:648] HybridClock initialized: now 1786211443900335 us; error 32 us; skew 500 ppm
Aug 08 17:50:43 dist-test-slave-bndk krb5kdc[8483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211443, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:43.902619 9122 init.cc:377] Logged in from keytab as oryx/127.28.213.131@KRBTEST.COM (short username oryx)
I20260808 17:50:43.903025 9122 webserver.cc:460] Webserver started at http://127.28.213.131:38281/ using document root <none> and password file <none>
I20260808 17:50:43.903231 9122 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:43.903276 9122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:43.903395 9122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:43.904345 9122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "3996c5c9c8ef45339daea70fc3aa3b26"
format_stamp: "Formatted at 2026-08-08 17:50:43 on dist-test-slave-bndk"
server_key: "ce6d6f824bae4b27312e7ae24467dbaf"
server_key_iv: "6c7585b57c455024ac768bbe5cd75bfc"
server_key_version: "encryptionkey@0"
I20260808 17:50:43.904657 9122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "3996c5c9c8ef45339daea70fc3aa3b26"
format_stamp: "Formatted at 2026-08-08 17:50:43 on dist-test-slave-bndk"
server_key: "ce6d6f824bae4b27312e7ae24467dbaf"
server_key_iv: "6c7585b57c455024ac768bbe5cd75bfc"
server_key_version: "encryptionkey@0"
I20260808 17:50:43.905905 9122 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:50:43.906517 9144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:43.906669 9122 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:43.906756 9122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "3996c5c9c8ef45339daea70fc3aa3b26"
format_stamp: "Formatted at 2026-08-08 17:50:43 on dist-test-slave-bndk"
server_key: "ce6d6f824bae4b27312e7ae24467dbaf"
server_key_iv: "6c7585b57c455024ac768bbe5cd75bfc"
server_key_version: "encryptionkey@0"
I20260808 17:50:43.906826 9122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:43.926271 9122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:43.928166 9122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:43.928288 9122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:43.928742 9122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:43.928779 9122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:43.928797 9122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:43.928808 9122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:43.934947 9122 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:40233
Aug 08 17:50:43 dist-test-slave-bndk krb5kdc[8483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211443, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM
I20260808 17:50:43.935009 9337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:40233 every 8 connection(s)
I20260808 17:50:43.935325 9122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:50:43.936902 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 9122
I20260808 17:50:43.936997 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:50:43.937170 29526 external_mini_cluster.cc:1428] Setting key e44745a86184610d1b0450c86e4df185
I20260808 17:50:43.938015 8649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.929135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:58609 (local address 127.28.213.190:35461)
0808 17:50:43.929199 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:43.929202 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:43.929370 (+ 168us) server_negotiation.cc:407] Connection header received
0808 17:50:43.929798 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:43.929800 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:43.929813 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:43.929887 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:43.930610 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.931356 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.932774 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.933066 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.933137 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.935520 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:43.935523 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:43.935523 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:43.935532 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:43.936637 (+ 1105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:43.937001 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:43.937002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:43.937002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:43.937068 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:43.937335 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:43.937336 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:43.937337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:43.937475 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:43.937534 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:43.937845 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 17:50:43.937928 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:50:43.938148 9161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.929077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:35461 (local address 127.28.213.131:58609)
0808 17:50:43.929254 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:43.929292 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:43.929712 (+ 420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:43.929948 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:43.929951 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:43.930239 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:43.930510 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:43.930516 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.931449 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.931451 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:43.932670 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:43.932673 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.933147 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.933148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:43.933302 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.933722 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:43.933728 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:43.935420 (+ 1692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:43.936701 (+ 1281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:43.936706 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:43.936708 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:43.936923 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:43.937129 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:43.937130 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:43.937130 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:43.937280 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:43.937535 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:43.937542 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:43.937707 (+ 165us) client_negotiation.cc:769] Sending connection context
0808 17:50:43.937803 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 17:50:43.937957 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":92,"threads_started":1}
I20260808 17:50:43.938534 9339 heartbeater.cc:347] Connected to a master server at 127.28.213.190:35461
I20260808 17:50:43.938606 9339 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:43.938773 9339 heartbeater.cc:511] Master 127.28.213.190:35461 requested a full tablet report, sending...
I20260808 17:50:43.939116 8557 ts_manager.cc:194] Registered new tserver with Master: 3996c5c9c8ef45339daea70fc3aa3b26 (127.28.213.131:40233)
I20260808 17:50:43.939460 8557 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:58609
I20260808 17:50:43.944020 8649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.939499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:41221 (local address 127.28.213.190:35461)
0808 17:50:43.939547 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:43.939549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:43.939617 (+ 68us) server_negotiation.cc:407] Connection header received
0808 17:50:43.939671 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:43.939672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:43.939682 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:43.939745 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:43.940067 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.940529 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.941178 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.941381 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.941431 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.942113 (+ 682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:43.942114 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:43.942114 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:43.942135 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:43.943284 (+ 1149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:43.943556 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:43.943557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:43.943557 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:43.943599 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:43.943707 (+ 108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:43.943707 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:43.943707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:43.943783 (+ 76us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:43.943824 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:43.943919 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 17:50:43.943968 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:50:43.944032 9347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.939425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:35461 (local address 127.28.213.131:41221)
0808 17:50:43.939568 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:43.939578 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:43.939630 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:43.939753 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:43.939754 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:43.939947 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:43.940005 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:43.940007 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.940611 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.940612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:43.941123 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:43.941125 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.941436 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.941436 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:43.941481 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.941800 (+ 319us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:43.941804 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:43.942049 (+ 245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:43.943352 (+ 1303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:43.943353 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:43.943353 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:43.943504 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:43.943634 (+ 130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:43.943634 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:43.943635 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:43.943675 (+ 40us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:43.943822 (+ 147us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:43.943823 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:43.943853 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 17:50:43.943896 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 17:50:43.943967 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":58,"threads_started":1}
I20260808 17:50:43.948761 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 17:50:43 dist-test-slave-bndk krb5kdc[8483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211443, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 17:50:43 dist-test-slave-bndk krb5kdc[8483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:43 dist-test-slave-bndk krb5kdc[8483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 17:50:43.969326 8649 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:43.964454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53988 (local address 127.28.213.190:35461)
0808 17:50:43.964498 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:43.964500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:43.964508 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:43.964559 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:43.964560 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:43.964567 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:43.964625 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:43.965157 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.965667 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.966388 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.966569 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.966616 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.969258 (+ 2642us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53988: BlockingRecv error: recv got EOF from 127.0.0.1:53988 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 08 17:50:43 dist-test-slave-bndk krb5kdc[8483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211443, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM
I20260808 17:50:43.975725 8649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.970018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54000 (local address 127.28.213.190:35461)
0808 17:50:43.970076 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:43.970077 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:43.970125 (+ 48us) server_negotiation.cc:407] Connection header received
0808 17:50:43.970179 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:43.970180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:43.970189 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:43.970232 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:43.970633 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.971073 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.971703 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.971877 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.971933 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.973725 (+ 1792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:43.973726 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:43.973726 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:43.973733 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:43.974789 (+ 1056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:43.975072 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:43.975073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:43.975074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:43.975124 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:43.975306 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:43.975307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:43.975307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:43.975401 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:43.975483 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:43.975583 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 17:50:43.975650 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 17:50:43.977025 8557 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54000:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:50:43.978534 8557 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:50:43.984251 9363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.980612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:33437 (local address 127.0.0.1:57328)
0808 17:50:43.980692 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:43.980703 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:43.980753 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:43.981077 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:43.981078 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:43.981080 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:43.981133 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:43.981135 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.982112 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.982113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:43.983275 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:43.983277 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.983981 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.983983 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:43.984060 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.984074 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 17:50:43.984136 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 17:50:43.984184 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64,"thread_start_us":36,"threads_started":1}
I20260808 17:50:43.984297 9373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.980768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57328 (local address 127.28.213.130:33437)
0808 17:50:43.980921 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:43.980925 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:43.980935 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:50:43.980968 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:43.980970 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:43.980986 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:43.981069 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:43.981289 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.982033 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.983369 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.983903 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.983983 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.984041 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:43.984159 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 17:50:43.984200 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":81,"threads_started":1}
I20260808 17:50:43.984419 9371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.980427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:40233 (local address 127.0.0.1:45048)
0808 17:50:43.980680 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:43.980689 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:43.980727 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:43.981150 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:43.981151 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:43.981152 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:43.981188 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:43.981189 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.982497 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.982498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:43.983278 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:43.983280 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.984205 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.984206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:43.984264 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.984268 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:43.984310 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 17:50:43.984351 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":47,"threads_started":1}
I20260808 17:50:43.984730 9364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.980422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:37049 (local address 127.0.0.1:49580)
0808 17:50:43.980575 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:43.980611 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:43.980671 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:43.980938 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:43.980941 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:43.980944 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:43.981001 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:43.981002 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.982406 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.982407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:43.983463 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:43.983465 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.984421 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.984422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:43.984600 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.984604 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:43.984640 (+ 36us) client_negotiation.cc:240] Negotiation successful
0808 17:50:43.984673 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":7,"thread_start_us":60,"threads_started":1}
I20260808 17:50:43.985090 9368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.980523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49580 (local address 127.28.213.129:37049)
0808 17:50:43.980803 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:43.980808 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:43.980817 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:50:43.980851 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:43.980852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:43.980864 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:43.980922 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:43.981232 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.982323 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.983539 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.984233 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.984860 (+ 627us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.984927 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:43.984953 (+ 26us) server_negotiation.cc:299] Negotiation successful
0808 17:50:43.984997 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":77,"threads_started":1}
I20260808 17:50:43.985073 9000 tablet_service.cc:1467] Processing CreateTablet for tablet f4499a364a1e4c8b9527447aac8f55be (DEFAULT_TABLE table=test-table [id=3550fb7fd8a843b5846a78f0eca2d976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:43.985525 9000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4499a364a1e4c8b9527447aac8f55be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:43.985688 8776 tablet_service.cc:1467] Processing CreateTablet for tablet f4499a364a1e4c8b9527447aac8f55be (DEFAULT_TABLE table=test-table [id=3550fb7fd8a843b5846a78f0eca2d976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:43.985966 8776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4499a364a1e4c8b9527447aac8f55be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:43.988438 9374 tablet_bootstrap.cc:492] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67: Bootstrap starting.
I20260808 17:50:43.988484 9366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:43.980507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45048 (local address 127.28.213.131:40233)
0808 17:50:43.981016 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:43.981019 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:43.981026 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:50:43.981055 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:43.981057 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:43.981071 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:43.981165 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:43.981345 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.982423 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.983363 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:43.984030 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:43.984117 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:43.984168 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:43.984520 (+ 352us) server_negotiation.cc:299] Negotiation successful
0808 17:50:43.984561 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":68,"threads_started":1}
I20260808 17:50:43.988992 9375 tablet_bootstrap.cc:492] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2: Bootstrap starting.
I20260808 17:50:43.989043 9374 tablet_bootstrap.cc:654] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:43.989032 9230 tablet_service.cc:1467] Processing CreateTablet for tablet f4499a364a1e4c8b9527447aac8f55be (DEFAULT_TABLE table=test-table [id=3550fb7fd8a843b5846a78f0eca2d976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:43.989387 9230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4499a364a1e4c8b9527447aac8f55be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:43.989420 9374 log.cc:824] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:43.989602 9375 tablet_bootstrap.cc:654] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:43.989908 9375 log.cc:824] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:43.990232 9374 tablet_bootstrap.cc:492] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67: No bootstrap required, opened a new log
I20260808 17:50:43.990305 9374 ts_tablet_manager.cc:1397] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:50:43.990649 9375 tablet_bootstrap.cc:492] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2: No bootstrap required, opened a new log
I20260808 17:50:43.990707 9375 ts_tablet_manager.cc:1397] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 17:50:43.992260 9374 raft_consensus.cc:348] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } } peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } }
I20260808 17:50:43.992302 9375 raft_consensus.cc:348] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } } peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } }
I20260808 17:50:43.992432 9375 raft_consensus.cc:374] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:43.992435 9374 raft_consensus.cc:374] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:43.992465 9375 raft_consensus.cc:729] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9387bfa05a614e9c91db94802a928ba2, State: Initialized, Role: FOLLOWER
I20260808 17:50:43.992476 9374 raft_consensus.cc:729] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a467bd081fee4d298f469f62c8d4cd67, State: Initialized, Role: FOLLOWER
I20260808 17:50:43.992583 9374 consensus_queue.cc:260] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } } peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } }
I20260808 17:50:43.992589 9375 consensus_queue.cc:260] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } } peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } }
I20260808 17:50:43.992815 9380 tablet_bootstrap.cc:492] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26: Bootstrap starting.
I20260808 17:50:43.992836 9375 ts_tablet_manager.cc:1428] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 17:50:43.992836 9374 ts_tablet_manager.cc:1428] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:50:43.992946 8875 heartbeater.cc:503] Master 127.28.213.190:35461 was elected leader, sending a full tablet report...
I20260808 17:50:43.992965 9106 heartbeater.cc:503] Master 127.28.213.190:35461 was elected leader, sending a full tablet report...
I20260808 17:50:43.993722 9380 tablet_bootstrap.cc:654] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:43.993985 9380 log.cc:824] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:43.994611 9380 tablet_bootstrap.cc:492] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26: No bootstrap required, opened a new log
I20260808 17:50:43.994674 9380 ts_tablet_manager.cc:1397] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:50:43.995915 9380 raft_consensus.cc:348] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } } peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } }
I20260808 17:50:43.996061 9380 raft_consensus.cc:374] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:43.996104 9380 raft_consensus.cc:729] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3996c5c9c8ef45339daea70fc3aa3b26, State: Initialized, Role: FOLLOWER
I20260808 17:50:43.996201 9380 consensus_queue.cc:260] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } } peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } }
I20260808 17:50:43.996417 9380 ts_tablet_manager.cc:1428] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:50:43.996469 9339 heartbeater.cc:503] Master 127.28.213.190:35461 was elected leader, sending a full tablet report...
I20260808 17:50:44.005421 9385 raft_consensus.cc:482] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:50:44.005496 9385 raft_consensus.cc:504] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } } peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } }
I20260808 17:50:44.005748 9385 leader_election.cc:288] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9387bfa05a614e9c91db94802a928ba2 (127.28.213.129:37049), a467bd081fee4d298f469f62c8d4cd67 (127.28.213.130:33437)
I20260808 17:50:44.008335 9161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.005875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:33437 (local address 127.28.213.131:37167)
0808 17:50:44.005929 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:44.005940 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:44.005977 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:44.006111 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:44.006112 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:44.006113 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:44.006168 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.006169 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.006771 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.006772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.007548 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.007551 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.008116 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.008117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.008189 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.008193 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:44.008243 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 17:50:44.008277 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 17:50:44.008349 9373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.005934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:37167 (local address 127.28.213.130:33437)
0808 17:50:44.005967 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:44.005969 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:44.005976 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:50:44.006026 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:44.006027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:44.006035 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:44.006108 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:44.006227 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.006706 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.007631 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.008042 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.008096 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.008103 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:44.008255 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 17:50:44.008289 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 17:50:44.008446 9368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.005927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:39961 (local address 127.28.213.129:37049)
0808 17:50:44.005962 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:44.005964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:44.006137 (+ 173us) server_negotiation.cc:407] Connection header received
0808 17:50:44.006183 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:44.006183 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:44.006192 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:44.006247 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:44.006369 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.006824 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.007718 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.008135 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.008192 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.008199 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:44.008359 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 17:50:44.008395 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:50:44.008617 9386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.005880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:37049 (local address 127.28.213.131:39961)
0808 17:50:44.006070 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:44.006081 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:44.006134 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:44.006252 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:44.006253 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:44.006254 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:44.006317 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.006319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.006893 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.006893 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.007619 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.007622 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.008213 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.008214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.008290 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.008294 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:44.008344 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 17:50:44.008535 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":45,"thread_start_us":86,"threads_started":1}
I20260808 17:50:44.008774 9032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4499a364a1e4c8b9527447aac8f55be" candidate_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a467bd081fee4d298f469f62c8d4cd67" is_pre_election: true
I20260808 17:50:44.008898 9032 raft_consensus.cc:2454] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3996c5c9c8ef45339daea70fc3aa3b26 in term 0.
I20260808 17:50:44.008877 8805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4499a364a1e4c8b9527447aac8f55be" candidate_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9387bfa05a614e9c91db94802a928ba2" is_pre_election: true
I20260808 17:50:44.009001 8805 raft_consensus.cc:2454] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3996c5c9c8ef45339daea70fc3aa3b26 in term 0.
I20260808 17:50:44.009106 9145 leader_election.cc:302] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3996c5c9c8ef45339daea70fc3aa3b26, a467bd081fee4d298f469f62c8d4cd67; no voters:
I20260808 17:50:44.009236 9385 raft_consensus.cc:2781] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:50:44.009302 9385 raft_consensus.cc:482] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:50:44.009318 9385 raft_consensus.cc:3037] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:44.010107 9385 raft_consensus.cc:504] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } } peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } }
I20260808 17:50:44.010232 9385 leader_election.cc:288] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [CANDIDATE]: Term 1 election: Requested vote from peers 9387bfa05a614e9c91db94802a928ba2 (127.28.213.129:37049), a467bd081fee4d298f469f62c8d4cd67 (127.28.213.130:33437)
I20260808 17:50:44.010380 8805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4499a364a1e4c8b9527447aac8f55be" candidate_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9387bfa05a614e9c91db94802a928ba2"
I20260808 17:50:44.010442 8805 raft_consensus.cc:3037] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:44.011009 8805 raft_consensus.cc:2454] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3996c5c9c8ef45339daea70fc3aa3b26 in term 1.
I20260808 17:50:44.011109 9032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4499a364a1e4c8b9527447aac8f55be" candidate_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a467bd081fee4d298f469f62c8d4cd67"
I20260808 17:50:44.011176 9149 leader_election.cc:302] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3996c5c9c8ef45339daea70fc3aa3b26, 9387bfa05a614e9c91db94802a928ba2; no voters:
I20260808 17:50:44.011186 9032 raft_consensus.cc:3037] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:44.011268 9385 raft_consensus.cc:2781] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:44.011417 9385 raft_consensus.cc:686] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 LEADER]: Becoming Leader. State: Replica: 3996c5c9c8ef45339daea70fc3aa3b26, State: Running, Role: LEADER
I20260808 17:50:44.011500 9385 consensus_queue.cc:237] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } } peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } }
I20260808 17:50:44.011945 9032 raft_consensus.cc:2454] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3996c5c9c8ef45339daea70fc3aa3b26 in term 1.
I20260808 17:50:44.012197 8557 catalog_manager.cc:5495] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3996c5c9c8ef45339daea70fc3aa3b26 (127.28.213.131). New cstate: current_term: 1 leader_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } health_report { overall_health: UNKNOWN } } }
I20260808 17:50:44.018716 9366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.016888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45052 (local address 127.28.213.131:40233)
0808 17:50:44.016954 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:44.016955 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:44.016961 (+ 6us) server_negotiation.cc:407] Connection header received
0808 17:50:44.016984 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:44.016984 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:44.016997 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:44.017046 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:44.017128 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.017585 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.018223 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.018385 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.018427 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.018521 (+ 94us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:44.018597 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:44.018643 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:44.018655 (+ 12us) server_negotiation.cc:299] Negotiation successful
0808 17:50:44.018667 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 17:50:44.020057 9032 raft_consensus.cc:1261] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67 [term 1 FOLLOWER]: Refusing update from remote peer 3996c5c9c8ef45339daea70fc3aa3b26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:44.020051 8805 raft_consensus.cc:1261] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2 [term 1 FOLLOWER]: Refusing update from remote peer 3996c5c9c8ef45339daea70fc3aa3b26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:44.020339 9385 consensus_queue.cc:1035] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:44.020471 9388 consensus_queue.cc:1035] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:44.022953 9394 mvcc.cc:205] Tried to move back new op lower bound from 7316322074704289792 to 7316322074671673344. Current Snapshot: MvccSnapshot[applied={T|T < 7316322074704289792}]
I20260808 17:50:44.024557 8557 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:44.024641 8557 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:44.025341 8557 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23: Sending DeleteTablet for 3 replicas of tablet f4499a364a1e4c8b9527447aac8f55be
I20260808 17:50:44.025645 8776 tablet_service.cc:1514] Processing DeleteTablet for tablet f4499a364a1e4c8b9527447aac8f55be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:44 UTC) from {username='oryx', principal='oryx/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:49580
I20260808 17:50:44.025719 9230 tablet_service.cc:1514] Processing DeleteTablet for tablet f4499a364a1e4c8b9527447aac8f55be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:44 UTC) from {username='oryx', principal='oryx/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:45048
I20260808 17:50:44.025835 8557 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54000:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 17:50:44.025945 9412 tablet_replica.cc:330] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26: stopping tablet replica
I20260808 17:50:44.025933 9000 tablet_service.cc:1514] Processing DeleteTablet for tablet f4499a364a1e4c8b9527447aac8f55be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:44 UTC) from {username='oryx', principal='oryx/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:57328
W20260808 17:50:44.025959 8557 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:50:44.026032 9412 raft_consensus.cc:2229] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:50:44.026132 9412 raft_consensus.cc:2258] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:44.026648 9412 ts_tablet_manager.cc:1905] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:44.026309 9415 tablet_replica.cc:330] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67: stopping tablet replica
I20260808 17:50:44.027065 9415 raft_consensus.cc:2229] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:44.027076 8776 tablet_service.cc:1467] Processing CreateTablet for tablet 2e51684815ac492ba1d608643e9e2f8f (DEFAULT_TABLE table=test-table [id=196041f2f8ff4727b22f0010894a0106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:44.027187 8776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e51684815ac492ba1d608643e9e2f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:44.027160 9000 tablet_service.cc:1467] Processing CreateTablet for tablet 2e51684815ac492ba1d608643e9e2f8f (DEFAULT_TABLE table=test-table [id=196041f2f8ff4727b22f0010894a0106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:44.027171 9415 raft_consensus.cc:2258] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:44.027267 9000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e51684815ac492ba1d608643e9e2f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:44.027590 9415 ts_tablet_manager.cc:1905] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:44.028650 9375 tablet_bootstrap.cc:492] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2: Bootstrap starting.
I20260808 17:50:44.028723 9230 tablet_service.cc:1467] Processing CreateTablet for tablet 2e51684815ac492ba1d608643e9e2f8f (DEFAULT_TABLE table=test-table [id=196041f2f8ff4727b22f0010894a0106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:44.028807 9230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e51684815ac492ba1d608643e9e2f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:44.029048 9375 tablet_bootstrap.cc:654] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:44.029189 9415 ts_tablet_manager.cc:1918] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:50:44.029277 9415 log.cc:1196] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/f4499a364a1e4c8b9527447aac8f55be
I20260808 17:50:44.029546 9415 ts_tablet_manager.cc:1939] T f4499a364a1e4c8b9527447aac8f55be P a467bd081fee4d298f469f62c8d4cd67: Deleting consensus metadata
I20260808 17:50:44.030015 9380 tablet_bootstrap.cc:492] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26: Bootstrap starting.
I20260808 17:50:44.030057 9374 tablet_bootstrap.cc:492] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67: Bootstrap starting.
I20260808 17:50:44.030404 9374 tablet_bootstrap.cc:654] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:44.030404 9380 tablet_bootstrap.cc:654] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:44.030999 8532 catalog_manager.cc:4841] TS a467bd081fee4d298f469f62c8d4cd67 (127.28.213.130:33437): tablet f4499a364a1e4c8b9527447aac8f55be (table test-table [id=3550fb7fd8a843b5846a78f0eca2d976]) successfully deleted
I20260808 17:50:44.031224 9380 tablet_bootstrap.cc:492] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26: No bootstrap required, opened a new log
I20260808 17:50:44.031248 9374 tablet_bootstrap.cc:492] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67: No bootstrap required, opened a new log
I20260808 17:50:44.031292 9374 ts_tablet_manager.cc:1397] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:44.031297 9380 ts_tablet_manager.cc:1397] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:44.031427 9374 raft_consensus.cc:348] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.031430 9380 raft_consensus.cc:348] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.031481 9374 raft_consensus.cc:374] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:44.031487 9380 raft_consensus.cc:374] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:44.031500 9374 raft_consensus.cc:729] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a467bd081fee4d298f469f62c8d4cd67, State: Initialized, Role: FOLLOWER
I20260808 17:50:44.031507 9380 raft_consensus.cc:729] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3996c5c9c8ef45339daea70fc3aa3b26, State: Initialized, Role: FOLLOWER
I20260808 17:50:44.031539 9374 consensus_queue.cc:260] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.031553 9380 consensus_queue.cc:260] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.031616 9374 ts_tablet_manager.cc:1428] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:44.031628 9380 ts_tablet_manager.cc:1428] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:44.032817 9412 ts_tablet_manager.cc:1918] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:50:44.032879 9412 log.cc:1196] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/f4499a364a1e4c8b9527447aac8f55be
I20260808 17:50:44.033123 9412 ts_tablet_manager.cc:1939] T f4499a364a1e4c8b9527447aac8f55be P 3996c5c9c8ef45339daea70fc3aa3b26: Deleting consensus metadata
I20260808 17:50:44.033501 8532 catalog_manager.cc:4841] TS 3996c5c9c8ef45339daea70fc3aa3b26 (127.28.213.131:40233): tablet f4499a364a1e4c8b9527447aac8f55be (table test-table [id=3550fb7fd8a843b5846a78f0eca2d976]) successfully deleted
I20260808 17:50:44.033644 9409 tablet_replica.cc:330] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2: stopping tablet replica
I20260808 17:50:44.033720 9375 tablet_bootstrap.cc:492] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2: No bootstrap required, opened a new log
I20260808 17:50:44.033735 9409 raft_consensus.cc:2229] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:44.033763 9375 ts_tablet_manager.cc:1397] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260808 17:50:44.033833 9409 raft_consensus.cc:2258] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:44.033896 9375 raft_consensus.cc:348] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.033959 9375 raft_consensus.cc:374] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:44.033978 9375 raft_consensus.cc:729] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9387bfa05a614e9c91db94802a928ba2, State: Initialized, Role: FOLLOWER
I20260808 17:50:44.034016 9375 consensus_queue.cc:260] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.034106 9375 ts_tablet_manager.cc:1428] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:44.034237 9409 ts_tablet_manager.cc:1905] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:44.035260 9409 ts_tablet_manager.cc:1918] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:50:44.035322 9409 log.cc:1196] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/wal/wals/f4499a364a1e4c8b9527447aac8f55be
I20260808 17:50:44.035527 9409 ts_tablet_manager.cc:1939] T f4499a364a1e4c8b9527447aac8f55be P 9387bfa05a614e9c91db94802a928ba2: Deleting consensus metadata
I20260808 17:50:44.035884 8535 catalog_manager.cc:4841] TS 9387bfa05a614e9c91db94802a928ba2 (127.28.213.129:37049): tablet f4499a364a1e4c8b9527447aac8f55be (table test-table [id=3550fb7fd8a843b5846a78f0eca2d976]) successfully deleted
W20260808 17:50:44.037974 9108 tablet.cc:2369] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:50:44.150038 8876 tablet.cc:2369] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:50:44.186349 9341 tablet.cc:2369] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:50:44.226343 9381 raft_consensus.cc:482] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:50:44.226436 9381 raft_consensus.cc:504] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.226732 9381 leader_election.cc:288] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9387bfa05a614e9c91db94802a928ba2 (127.28.213.129:37049), 3996c5c9c8ef45339daea70fc3aa3b26 (127.28.213.131:40233)
I20260808 17:50:44.229571 9368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.226963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:57891 (local address 127.28.213.129:37049)
0808 17:50:44.227018 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:44.227020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:44.227163 (+ 143us) server_negotiation.cc:407] Connection header received
0808 17:50:44.227193 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:44.227194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:44.227202 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:44.227246 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:44.227409 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.227874 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.228826 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.229183 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.229259 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.229270 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:44.229464 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 17:50:44.229501 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 17:50:44.229578 9366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.226963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:45505 (local address 127.28.213.131:40233)
0808 17:50:44.227014 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:44.227016 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:44.227029 (+ 13us) server_negotiation.cc:407] Connection header received
0808 17:50:44.227069 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:44.227069 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:44.227081 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:44.227156 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:44.227435 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.227895 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.228820 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.229178 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.229269 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.229278 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:44.229468 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 17:50:44.229505 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:50:44.229598 8932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.226900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:40233 (local address 127.28.213.130:45505)
0808 17:50:44.226959 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:44.226969 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:44.227017 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:44.227288 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:44.227289 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:44.227290 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:44.227344 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.227346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.227967 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.227968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.228734 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.228736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.229323 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.229324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.229399 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.229403 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:44.229453 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 17:50:44.229496 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":28}
I20260808 17:50:44.229786 9419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.226906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:37049 (local address 127.28.213.130:57891)
0808 17:50:44.227080 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:44.227091 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:44.227149 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:44.227258 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:44.227259 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:44.227260 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:44.227339 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.227340 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.227943 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.227944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.228744 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.228746 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.229339 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.229340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.229395 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.229399 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:44.229450 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 17:50:44.229496 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":43,"thread_start_us":88,"threads_started":1}
I20260808 17:50:44.229862 9260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e51684815ac492ba1d608643e9e2f8f" candidate_uuid: "a467bd081fee4d298f469f62c8d4cd67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" is_pre_election: true
I20260808 17:50:44.230027 9260 raft_consensus.cc:2454] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a467bd081fee4d298f469f62c8d4cd67 in term 0.
I20260808 17:50:44.230041 8805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e51684815ac492ba1d608643e9e2f8f" candidate_uuid: "a467bd081fee4d298f469f62c8d4cd67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9387bfa05a614e9c91db94802a928ba2" is_pre_election: true
I20260808 17:50:44.230127 8805 raft_consensus.cc:2454] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a467bd081fee4d298f469f62c8d4cd67 in term 0.
I20260808 17:50:44.230222 8917 leader_election.cc:302] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3996c5c9c8ef45339daea70fc3aa3b26, a467bd081fee4d298f469f62c8d4cd67; no voters:
I20260808 17:50:44.230342 9381 raft_consensus.cc:2781] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:50:44.230379 9381 raft_consensus.cc:482] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:50:44.230413 9381 raft_consensus.cc:3037] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:44.231077 9381 raft_consensus.cc:504] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.231196 9381 leader_election.cc:288] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [CANDIDATE]: Term 1 election: Requested vote from peers 9387bfa05a614e9c91db94802a928ba2 (127.28.213.129:37049), 3996c5c9c8ef45339daea70fc3aa3b26 (127.28.213.131:40233)
I20260808 17:50:44.231346 8805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e51684815ac492ba1d608643e9e2f8f" candidate_uuid: "a467bd081fee4d298f469f62c8d4cd67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9387bfa05a614e9c91db94802a928ba2"
I20260808 17:50:44.231416 8805 raft_consensus.cc:3037] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:44.231976 8805 raft_consensus.cc:2454] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a467bd081fee4d298f469f62c8d4cd67 in term 1.
I20260808 17:50:44.232080 9260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e51684815ac492ba1d608643e9e2f8f" candidate_uuid: "a467bd081fee4d298f469f62c8d4cd67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3996c5c9c8ef45339daea70fc3aa3b26"
I20260808 17:50:44.232128 8922 leader_election.cc:302] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9387bfa05a614e9c91db94802a928ba2, a467bd081fee4d298f469f62c8d4cd67; no voters:
I20260808 17:50:44.232156 9260 raft_consensus.cc:3037] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:44.232208 9381 raft_consensus.cc:2781] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:44.232329 9381 raft_consensus.cc:686] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [term 1 LEADER]: Becoming Leader. State: Replica: a467bd081fee4d298f469f62c8d4cd67, State: Running, Role: LEADER
I20260808 17:50:44.232420 9381 consensus_queue.cc:237] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.232894 9260 raft_consensus.cc:2454] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a467bd081fee4d298f469f62c8d4cd67 in term 1.
I20260808 17:50:44.233114 8556 catalog_manager.cc:5495] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 reported cstate change: term changed from 0 to 1, leader changed from <none> to a467bd081fee4d298f469f62c8d4cd67 (127.28.213.130). New cstate: current_term: 1 leader_uuid: "a467bd081fee4d298f469f62c8d4cd67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } health_report { overall_health: UNKNOWN } } }
Aug 08 17:50:44 dist-test-slave-bndk krb5kdc[8483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211443, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.190@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM
I20260808 17:50:44.284132 9429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.277928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:35461 (local address 127.0.0.1:54016)
0808 17:50:44.278084 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:44.278094 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:44.278160 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:44.278284 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:44.278284 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:44.278591 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:44.278642 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.278644 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.279268 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.279268 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.279793 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.279794 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.280057 (+ 263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.280058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.280093 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.280542 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:44.280547 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:44.281912 (+ 1365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:44.283317 (+ 1405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:44.283323 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:44.283325 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:44.283503 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:44.283640 (+ 137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:44.283641 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:44.283641 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:44.283689 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:44.283856 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:44.283860 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:44.283895 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 17:50:44.283937 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 17:50:44.284043 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":91,"threads_started":1}
I20260808 17:50:44.284175 8649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.277971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54016 (local address 127.28.213.190:35461)
0808 17:50:44.278048 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:44.278051 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:44.278153 (+ 102us) server_negotiation.cc:407] Connection header received
0808 17:50:44.278208 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:44.278208 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:44.278221 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:44.278289 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:44.278728 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.279210 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.279844 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.280014 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.280056 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.281992 (+ 1936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:44.281994 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:44.281994 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:44.282000 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:44.283250 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:44.283553 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:44.283553 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:44.283554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:44.283600 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:44.283727 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:44.283728 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:44.283728 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:44.283817 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:44.283861 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:44.283961 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 17:50:44.284087 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":47}
I20260808 17:50:44.285939 8556 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:54016:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 17:50:44.286124 8556 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:50:44.287454 9000 tablet_service.cc:1467] Processing CreateTablet for tablet e05cb71911144c168764f7604ff78465 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=705ea8d84ebc41b3a91b5f1b2d8fb90c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 17:50:44.287498 9230 tablet_service.cc:1467] Processing CreateTablet for tablet e05cb71911144c168764f7604ff78465 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=705ea8d84ebc41b3a91b5f1b2d8fb90c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 17:50:44.287612 9000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e05cb71911144c168764f7604ff78465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:44.287636 9230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e05cb71911144c168764f7604ff78465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:44.288816 9380 tablet_bootstrap.cc:492] T e05cb71911144c168764f7604ff78465 P 3996c5c9c8ef45339daea70fc3aa3b26: Bootstrap starting.
I20260808 17:50:44.288793 8776 tablet_service.cc:1467] Processing CreateTablet for tablet e05cb71911144c168764f7604ff78465 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=705ea8d84ebc41b3a91b5f1b2d8fb90c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 17:50:44.288940 8776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e05cb71911144c168764f7604ff78465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:44.289131 9380 tablet_bootstrap.cc:654] T e05cb71911144c168764f7604ff78465 P 3996c5c9c8ef45339daea70fc3aa3b26: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:44.289662 9380 tablet_bootstrap.cc:492] T e05cb71911144c168764f7604ff78465 P 3996c5c9c8ef45339daea70fc3aa3b26: No bootstrap required, opened a new log
I20260808 17:50:44.289705 9380 ts_tablet_manager.cc:1397] T e05cb71911144c168764f7604ff78465 P 3996c5c9c8ef45339daea70fc3aa3b26: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:44.289798 9380 raft_consensus.cc:348] T e05cb71911144c168764f7604ff78465 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.289863 9380 raft_consensus.cc:374] T e05cb71911144c168764f7604ff78465 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:44.289875 9380 raft_consensus.cc:729] T e05cb71911144c168764f7604ff78465 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3996c5c9c8ef45339daea70fc3aa3b26, State: Initialized, Role: FOLLOWER
I20260808 17:50:44.289911 9380 consensus_queue.cc:260] T e05cb71911144c168764f7604ff78465 P 3996c5c9c8ef45339daea70fc3aa3b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.290021 9380 ts_tablet_manager.cc:1428] T e05cb71911144c168764f7604ff78465 P 3996c5c9c8ef45339daea70fc3aa3b26: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:44.290037 9388 tablet_replica.cc:439] T e05cb71911144c168764f7604ff78465 P 3996c5c9c8ef45339daea70fc3aa3b26: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } } }
I20260808 17:50:44.290109 9388 tablet_replica.cc:442] T e05cb71911144c168764f7604ff78465 P 3996c5c9c8ef45339daea70fc3aa3b26: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:44.290325 9375 tablet_bootstrap.cc:492] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2: Bootstrap starting.
I20260808 17:50:44.290354 9374 tablet_bootstrap.cc:492] T e05cb71911144c168764f7604ff78465 P a467bd081fee4d298f469f62c8d4cd67: Bootstrap starting.
I20260808 17:50:44.290652 9375 tablet_bootstrap.cc:654] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:44.290758 9374 tablet_bootstrap.cc:654] T e05cb71911144c168764f7604ff78465 P a467bd081fee4d298f469f62c8d4cd67: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:44.291250 9375 tablet_bootstrap.cc:492] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2: No bootstrap required, opened a new log
I20260808 17:50:44.291314 9375 ts_tablet_manager.cc:1397] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 17:50:44.291446 9375 raft_consensus.cc:348] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.291507 9375 raft_consensus.cc:374] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:44.291520 9375 raft_consensus.cc:729] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9387bfa05a614e9c91db94802a928ba2, State: Initialized, Role: FOLLOWER
I20260808 17:50:44.291553 9375 consensus_queue.cc:260] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.291651 9375 ts_tablet_manager.cc:1428] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:44.291698 9382 tablet_replica.cc:439] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } } }
I20260808 17:50:44.291785 9382 tablet_replica.cc:442] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:44.291971 9374 tablet_bootstrap.cc:492] T e05cb71911144c168764f7604ff78465 P a467bd081fee4d298f469f62c8d4cd67: No bootstrap required, opened a new log
I20260808 17:50:44.292027 9374 ts_tablet_manager.cc:1397] T e05cb71911144c168764f7604ff78465 P a467bd081fee4d298f469f62c8d4cd67: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:50:44.292166 9374 raft_consensus.cc:348] T e05cb71911144c168764f7604ff78465 P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.292230 9374 raft_consensus.cc:374] T e05cb71911144c168764f7604ff78465 P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:44.292248 9374 raft_consensus.cc:729] T e05cb71911144c168764f7604ff78465 P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a467bd081fee4d298f469f62c8d4cd67, State: Initialized, Role: FOLLOWER
I20260808 17:50:44.292289 9374 consensus_queue.cc:260] T e05cb71911144c168764f7604ff78465 P a467bd081fee4d298f469f62c8d4cd67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.292382 9374 ts_tablet_manager.cc:1428] T e05cb71911144c168764f7604ff78465 P a467bd081fee4d298f469f62c8d4cd67: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:44.292446 9420 tablet_replica.cc:439] T e05cb71911144c168764f7604ff78465 P a467bd081fee4d298f469f62c8d4cd67: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } } }
I20260808 17:50:44.292523 9420 tablet_replica.cc:442] T e05cb71911144c168764f7604ff78465 P a467bd081fee4d298f469f62c8d4cd67: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:44.295781 9382 raft_consensus.cc:482] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:50:44.295831 9382 raft_consensus.cc:504] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.296069 9382 leader_election.cc:288] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a467bd081fee4d298f469f62c8d4cd67 (127.28.213.130:33437), 3996c5c9c8ef45339daea70fc3aa3b26 (127.28.213.131:40233)
I20260808 17:50:44.299418 9373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.296227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:47663 (local address 127.28.213.130:33437)
0808 17:50:44.296271 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:44.296273 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:44.296347 (+ 74us) server_negotiation.cc:407] Connection header received
0808 17:50:44.296437 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:44.296438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:44.296449 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:44.296494 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:44.296661 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.297402 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.298737 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.299109 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.299172 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.299181 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:44.299322 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 17:50:44.299356 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:50:44.299420 9366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.296355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:37967 (local address 127.28.213.131:40233)
0808 17:50:44.296390 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:44.296392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:44.296614 (+ 222us) server_negotiation.cc:407] Connection header received
0808 17:50:44.296701 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:44.296702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:44.296710 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:44.296762 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:50:44.296892 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.297560 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.298774 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.299123 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.299181 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.299189 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:44.299323 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 17:50:44.299359 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:50:44.299448 9436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.296180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:33437 (local address 127.28.213.129:47663)
0808 17:50:44.296282 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:44.296293 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:44.296376 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:44.296536 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:44.296537 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:44.296539 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:44.296603 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.296605 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.297466 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.297467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.298635 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.298637 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.299183 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.299184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.299263 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.299267 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:50:44.299312 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 17:50:44.299354 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73,"thread_start_us":39,"threads_started":1}
I20260808 17:50:44.299623 9437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.296307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:40233 (local address 127.28.213.129:37967)
0808 17:50:44.296433 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:44.296443 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:44.296645 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:44.296766 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:44.296766 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:44.296767 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:50:44.296840 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.296842 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.297623 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.297623 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.298675 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.298677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.299193 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.299194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.299266 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.299269 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:50:44.299313 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 17:50:44.299368 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":12,"thread_start_us":61,"threads_started":1}
I20260808 17:50:44.299644 9032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e05cb71911144c168764f7604ff78465" candidate_uuid: "9387bfa05a614e9c91db94802a928ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a467bd081fee4d298f469f62c8d4cd67" is_pre_election: true
I20260808 17:50:44.299714 9032 raft_consensus.cc:2454] T e05cb71911144c168764f7604ff78465 P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9387bfa05a614e9c91db94802a928ba2 in term 0.
I20260808 17:50:44.299871 9260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e05cb71911144c168764f7604ff78465" candidate_uuid: "9387bfa05a614e9c91db94802a928ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" is_pre_election: true
I20260808 17:50:44.299880 8699 leader_election.cc:302] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9387bfa05a614e9c91db94802a928ba2, a467bd081fee4d298f469f62c8d4cd67; no voters:
I20260808 17:50:44.299957 9260 raft_consensus.cc:2454] T e05cb71911144c168764f7604ff78465 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9387bfa05a614e9c91db94802a928ba2 in term 0.
I20260808 17:50:44.300005 9382 raft_consensus.cc:2781] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:50:44.300050 9382 raft_consensus.cc:482] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:50:44.300076 9382 raft_consensus.cc:3037] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:44.300603 9382 raft_consensus.cc:504] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.300693 9382 leader_election.cc:288] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 [CANDIDATE]: Term 1 election: Requested vote from peers a467bd081fee4d298f469f62c8d4cd67 (127.28.213.130:33437), 3996c5c9c8ef45339daea70fc3aa3b26 (127.28.213.131:40233)
I20260808 17:50:44.300824 9032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e05cb71911144c168764f7604ff78465" candidate_uuid: "9387bfa05a614e9c91db94802a928ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a467bd081fee4d298f469f62c8d4cd67"
I20260808 17:50:44.300861 9260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e05cb71911144c168764f7604ff78465" candidate_uuid: "9387bfa05a614e9c91db94802a928ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3996c5c9c8ef45339daea70fc3aa3b26"
I20260808 17:50:44.300912 9032 raft_consensus.cc:3037] T e05cb71911144c168764f7604ff78465 P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:44.300926 9260 raft_consensus.cc:3037] T e05cb71911144c168764f7604ff78465 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:44.301487 9032 raft_consensus.cc:2454] T e05cb71911144c168764f7604ff78465 P a467bd081fee4d298f469f62c8d4cd67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9387bfa05a614e9c91db94802a928ba2 in term 1.
I20260808 17:50:44.301527 9260 raft_consensus.cc:2454] T e05cb71911144c168764f7604ff78465 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9387bfa05a614e9c91db94802a928ba2 in term 1.
I20260808 17:50:44.301644 8699 leader_election.cc:302] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9387bfa05a614e9c91db94802a928ba2, a467bd081fee4d298f469f62c8d4cd67; no voters:
I20260808 17:50:44.301741 9382 raft_consensus.cc:2781] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:44.301854 9382 raft_consensus.cc:686] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 [term 1 LEADER]: Becoming Leader. State: Replica: 9387bfa05a614e9c91db94802a928ba2, State: Running, Role: LEADER
I20260808 17:50:44.301921 9382 consensus_queue.cc:237] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.302222 9438 tablet_replica.cc:439] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2: TxnStatusTablet state changed. Reason: New leader 9387bfa05a614e9c91db94802a928ba2. Latest consensus state: current_term: 1 leader_uuid: "9387bfa05a614e9c91db94802a928ba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } } }
I20260808 17:50:44.302305 9438 tablet_replica.cc:442] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2: This TxnStatusTablet replica's current role is: LEADER
I20260808 17:50:44.302474 9441 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 17:50:44.302513 8556 catalog_manager.cc:5495] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9387bfa05a614e9c91db94802a928ba2 (127.28.213.129). New cstate: current_term: 1 leader_uuid: "9387bfa05a614e9c91db94802a928ba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } health_report { overall_health: UNKNOWN } } }
I20260808 17:50:44.302579 9441 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 17:50:44.308542 9368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.306012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49594 (local address 127.28.213.129:37049)
0808 17:50:44.306055 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:44.306057 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:44.306132 (+ 75us) server_negotiation.cc:407] Connection header received
0808 17:50:44.306228 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:44.306229 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:44.306243 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:44.306297 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:44.306443 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.306862 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.307881 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.308057 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.308098 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.308279 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:44.308362 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:44.308415 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:44.308482 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 17:50:44.308496 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:50:44.308596 9429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.305977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:37049 (local address 127.0.0.1:49594)
0808 17:50:44.306078 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:44.306089 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:44.306144 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:44.306322 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:44.306323 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:44.306324 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:50:44.306368 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.306370 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.306930 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.306931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.307806 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.307809 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.308117 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.308118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.308181 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.308201 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:50:44.308414 (+ 213us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:50:44.308420 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 17:50:44.308479 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:50:44.308524 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 17:50:44.309561 9032 raft_consensus.cc:1261] T e05cb71911144c168764f7604ff78465 P a467bd081fee4d298f469f62c8d4cd67 [term 1 FOLLOWER]: Refusing update from remote peer 9387bfa05a614e9c91db94802a928ba2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:44.309682 9260 raft_consensus.cc:1261] T e05cb71911144c168764f7604ff78465 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 FOLLOWER]: Refusing update from remote peer 9387bfa05a614e9c91db94802a928ba2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:44.309939 9382 consensus_queue.cc:1035] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:44.310072 9438 consensus_queue.cc:1035] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:44.310552 9420 tablet_replica.cc:439] T e05cb71911144c168764f7604ff78465 P a467bd081fee4d298f469f62c8d4cd67: TxnStatusTablet state changed. Reason: New leader 9387bfa05a614e9c91db94802a928ba2. Latest consensus state: current_term: 1 leader_uuid: "9387bfa05a614e9c91db94802a928ba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } } }
I20260808 17:50:44.310636 9420 tablet_replica.cc:442] T e05cb71911144c168764f7604ff78465 P a467bd081fee4d298f469f62c8d4cd67: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:44.310675 9388 tablet_replica.cc:439] T e05cb71911144c168764f7604ff78465 P 3996c5c9c8ef45339daea70fc3aa3b26: TxnStatusTablet state changed. Reason: New leader 9387bfa05a614e9c91db94802a928ba2. Latest consensus state: current_term: 1 leader_uuid: "9387bfa05a614e9c91db94802a928ba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } } }
I20260808 17:50:44.310766 9388 tablet_replica.cc:442] T e05cb71911144c168764f7604ff78465 P 3996c5c9c8ef45339daea70fc3aa3b26: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:44.311089 9382 tablet_replica.cc:439] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9387bfa05a614e9c91db94802a928ba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } } }
I20260808 17:50:44.311165 9382 tablet_replica.cc:442] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2: This TxnStatusTablet replica's current role is: LEADER
I20260808 17:50:44.311800 9397 mvcc.cc:205] Tried to move back new op lower bound from 7316322075890323456 to 7316322075861127168. Current Snapshot: MvccSnapshot[applied={T|T < 7316322075890323456}]
I20260808 17:50:44.311851 9382 tablet_replica.cc:439] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9387bfa05a614e9c91db94802a928ba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } } }
I20260808 17:50:44.311918 9382 tablet_replica.cc:442] T e05cb71911144c168764f7604ff78465 P 9387bfa05a614e9c91db94802a928ba2: This TxnStatusTablet replica's current role is: LEADER
I20260808 17:50:44.311880 9420 tablet_replica.cc:439] T e05cb71911144c168764f7604ff78465 P a467bd081fee4d298f469f62c8d4cd67: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9387bfa05a614e9c91db94802a928ba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } } }
I20260808 17:50:44.311955 9420 tablet_replica.cc:442] T e05cb71911144c168764f7604ff78465 P a467bd081fee4d298f469f62c8d4cd67: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:44.312412 9392 mvcc.cc:205] Tried to move back new op lower bound from 7316322075890323456 to 7316322075861127168. Current Snapshot: MvccSnapshot[applied={T|T < 7316322075890323456}]
I20260808 17:50:44.312507 9388 tablet_replica.cc:439] T e05cb71911144c168764f7604ff78465 P 3996c5c9c8ef45339daea70fc3aa3b26: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9387bfa05a614e9c91db94802a928ba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } } }
I20260808 17:50:44.312573 9388 tablet_replica.cc:442] T e05cb71911144c168764f7604ff78465 P 3996c5c9c8ef45339daea70fc3aa3b26: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 17:50:44.315917 9373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.313573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57330 (local address 127.28.213.130:33437)
0808 17:50:44.313609 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:44.313611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:44.313640 (+ 29us) server_negotiation.cc:407] Connection header received
0808 17:50:44.313718 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:44.313719 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:44.313732 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:44.313782 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:44.313885 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.314307 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.315310 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.315479 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.315518 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.315665 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:44.315747 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:44.315789 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:44.315839 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 17:50:44.315852 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 17:50:44.320282 9368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.318193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:45813 (local address 127.28.213.129:37049)
0808 17:50:44.318226 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:44.318228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:44.318360 (+ 132us) server_negotiation.cc:407] Connection header received
0808 17:50:44.318421 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:44.318421 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:44.318430 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:44.318474 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:44.318599 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.319025 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.319697 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.319875 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.319928 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.320079 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:44.320106 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:44.320145 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:44.320200 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 17:50:44.320218 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 17:50:44.320305 9452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.318146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:37049 (local address 127.28.213.130:45813)
0808 17:50:44.318300 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:44.318309 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:44.318361 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:44.318480 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:44.318481 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:44.318482 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:50:44.318548 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.318550 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.319089 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.319090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.319630 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.319631 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.319937 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.319938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.320001 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.320015 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:50:44.320152 (+ 137us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:50:44.320154 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:50:44.320189 (+ 35us) client_negotiation.cc:240] Negotiation successful
0808 17:50:44.320227 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":93,"threads_started":1}
I20260808 17:50:44.322336 9260 raft_consensus.cc:1261] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 FOLLOWER]: Refusing update from remote peer a467bd081fee4d298f469f62c8d4cd67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:44.322358 8805 raft_consensus.cc:1261] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2 [term 1 FOLLOWER]: Refusing update from remote peer a467bd081fee4d298f469f62c8d4cd67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:44.322579 9381 consensus_queue.cc:1035] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:44.322749 9420 consensus_queue.cc:1035] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:44.330054 9373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.327565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:53919 (local address 127.28.213.130:33437)
0808 17:50:44.327600 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:44.327602 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:44.327728 (+ 126us) server_negotiation.cc:407] Connection header received
0808 17:50:44.327781 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:44.327782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:44.327791 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:44.327834 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:44.327987 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.328471 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.329189 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.329460 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.329518 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.329816 (+ 298us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:44.329847 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:44.329891 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:44.329971 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 17:50:44.329994 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:50:44.330066 9460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.327492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:33437 (local address 127.28.213.129:53919)
0808 17:50:44.327673 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:44.327683 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:44.327736 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:44.327870 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:44.327871 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:44.327872 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:50:44.327927 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.327928 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.328544 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.328545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.329120 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.329122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.329624 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.329626 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.329694 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.329711 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:50:44.329916 (+ 205us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:50:44.329918 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:50:44.329961 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 17:50:44.330001 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":70,"threads_started":1}
I20260808 17:50:44.336199 8554 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:44.336280 8554 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:44.336810 8554 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23: Sending DeleteTablet for 3 replicas of tablet 2e51684815ac492ba1d608643e9e2f8f
I20260808 17:50:44.337015 9000 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e51684815ac492ba1d608643e9e2f8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:44 UTC) from {username='oryx', principal='oryx/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:57328
I20260808 17:50:44.337039 9230 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e51684815ac492ba1d608643e9e2f8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:44 UTC) from {username='oryx', principal='oryx/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:45048
I20260808 17:50:44.337112 9415 tablet_replica.cc:330] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67: stopping tablet replica
I20260808 17:50:44.337112 9412 tablet_replica.cc:330] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26: stopping tablet replica
I20260808 17:50:44.337158 9412 raft_consensus.cc:2229] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:44.337162 9415 raft_consensus.cc:2229] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:50:44.337193 9412 raft_consensus.cc:2258] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:44.337255 9415 raft_consensus.cc:2258] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:44.337623 8776 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e51684815ac492ba1d608643e9e2f8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:44 UTC) from {username='oryx', principal='oryx/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:49580
I20260808 17:50:44.337699 9409 tablet_replica.cc:330] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2: stopping tablet replica
I20260808 17:50:44.337711 9415 ts_tablet_manager.cc:1905] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:44.337740 9409 raft_consensus.cc:2229] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:44.337769 9409 raft_consensus.cc:2258] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:44.338049 9412 ts_tablet_manager.cc:1905] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:44.338085 9409 ts_tablet_manager.cc:1905] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:44.339435 9415 ts_tablet_manager.cc:1918] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:50:44.339483 9415 log.cc:1196] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/2e51684815ac492ba1d608643e9e2f8f
I20260808 17:50:44.339686 9412 ts_tablet_manager.cc:1918] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:50:44.339701 9415 ts_tablet_manager.cc:1939] T 2e51684815ac492ba1d608643e9e2f8f P a467bd081fee4d298f469f62c8d4cd67: Deleting consensus metadata
I20260808 17:50:44.339735 9412 log.cc:1196] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/2e51684815ac492ba1d608643e9e2f8f
I20260808 17:50:44.339915 9412 ts_tablet_manager.cc:1939] T 2e51684815ac492ba1d608643e9e2f8f P 3996c5c9c8ef45339daea70fc3aa3b26: Deleting consensus metadata
I20260808 17:50:44.339905 9409 ts_tablet_manager.cc:1918] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:50:44.339960 9409 log.cc:1196] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/wal/wals/2e51684815ac492ba1d608643e9e2f8f
I20260808 17:50:44.340065 8532 catalog_manager.cc:4841] TS a467bd081fee4d298f469f62c8d4cd67 (127.28.213.130:33437): tablet 2e51684815ac492ba1d608643e9e2f8f (table test-table [id=196041f2f8ff4727b22f0010894a0106]) successfully deleted
I20260808 17:50:44.340174 9409 ts_tablet_manager.cc:1939] T 2e51684815ac492ba1d608643e9e2f8f P 9387bfa05a614e9c91db94802a928ba2: Deleting consensus metadata
I20260808 17:50:44.340302 8532 catalog_manager.cc:4841] TS 3996c5c9c8ef45339daea70fc3aa3b26 (127.28.213.131:40233): tablet 2e51684815ac492ba1d608643e9e2f8f (table test-table [id=196041f2f8ff4727b22f0010894a0106]) successfully deleted
I20260808 17:50:44.340500 8535 catalog_manager.cc:4841] TS 9387bfa05a614e9c91db94802a928ba2 (127.28.213.129:37049): tablet 2e51684815ac492ba1d608643e9e2f8f (table test-table [id=196041f2f8ff4727b22f0010894a0106]) successfully deleted
Aug 08 17:50:44 dist-test-slave-bndk krb5kdc[8483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 17:50:44 dist-test-slave-bndk krb5kdc[8483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:44 dist-test-slave-bndk krb5kdc[8483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 17:50:44.363658 8649 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:44.358582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54030 (local address 127.28.213.190:35461)
0808 17:50:44.358628 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:44.358631 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:44.358738 (+ 107us) server_negotiation.cc:407] Connection header received
0808 17:50:44.358807 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:44.358808 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:44.358818 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:44.358864 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:44.359431 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.359915 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.360720 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.360918 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.360971 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.363610 (+ 2639us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54030: BlockingRecv error: recv got EOF from 127.0.0.1:54030 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 08 17:50:44 dist-test-slave-bndk krb5kdc[8483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM
I20260808 17:50:44.371007 8649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.364622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54046 (local address 127.28.213.190:35461)
0808 17:50:44.364669 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:44.364671 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:44.364721 (+ 50us) server_negotiation.cc:407] Connection header received
0808 17:50:44.364786 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:44.364787 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:44.364803 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:44.364846 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:44.365291 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.365872 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.366525 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.366740 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.366798 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.368683 (+ 1885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:44.368684 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:44.368684 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:44.368692 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:44.370035 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:44.370338 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:44.370340 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:44.370340 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:44.370396 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:44.370557 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:44.370558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:44.370558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:44.370661 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:44.370743 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:44.370849 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 17:50:44.370922 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:50:44.372514 8554 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54046:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:50:44.372668 8554 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:50:44.374047 8776 tablet_service.cc:1467] Processing CreateTablet for tablet 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 (DEFAULT_TABLE table=test-table [id=5c9002daf6294ce9aa8d996dc402d53f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:44.374183 8776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a14b5a3ad6f4e0bbf7f3d49d8897fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:44.375329 9375 tablet_bootstrap.cc:492] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2: Bootstrap starting.
I20260808 17:50:44.375370 9000 tablet_service.cc:1467] Processing CreateTablet for tablet 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 (DEFAULT_TABLE table=test-table [id=5c9002daf6294ce9aa8d996dc402d53f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:44.375481 9000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a14b5a3ad6f4e0bbf7f3d49d8897fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:44.375681 9375 tablet_bootstrap.cc:654] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:44.376611 9375 tablet_bootstrap.cc:492] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2: No bootstrap required, opened a new log
I20260808 17:50:44.376662 9375 ts_tablet_manager.cc:1397] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 17:50:44.376816 9375 raft_consensus.cc:348] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.376843 9230 tablet_service.cc:1467] Processing CreateTablet for tablet 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 (DEFAULT_TABLE table=test-table [id=5c9002daf6294ce9aa8d996dc402d53f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:44.376880 9375 raft_consensus.cc:374] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:44.376897 9375 raft_consensus.cc:729] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9387bfa05a614e9c91db94802a928ba2, State: Initialized, Role: FOLLOWER
I20260808 17:50:44.376924 9375 consensus_queue.cc:260] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.376952 9230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a14b5a3ad6f4e0bbf7f3d49d8897fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:44.377003 9375 ts_tablet_manager.cc:1428] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:44.378124 9374 tablet_bootstrap.cc:492] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67: Bootstrap starting.
I20260808 17:50:44.378484 9374 tablet_bootstrap.cc:654] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:44.378896 9380 tablet_bootstrap.cc:492] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26: Bootstrap starting.
I20260808 17:50:44.379190 9380 tablet_bootstrap.cc:654] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:44.379925 9380 tablet_bootstrap.cc:492] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26: No bootstrap required, opened a new log
I20260808 17:50:44.379969 9380 ts_tablet_manager.cc:1397] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:44.380066 9380 raft_consensus.cc:348] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.380126 9380 raft_consensus.cc:374] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:44.380144 9380 raft_consensus.cc:729] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3996c5c9c8ef45339daea70fc3aa3b26, State: Initialized, Role: FOLLOWER
I20260808 17:50:44.380188 9380 consensus_queue.cc:260] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.380861 9374 tablet_bootstrap.cc:492] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67: No bootstrap required, opened a new log
I20260808 17:50:44.380911 9374 ts_tablet_manager.cc:1397] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 17:50:44.381053 9374 raft_consensus.cc:348] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.381109 9374 raft_consensus.cc:374] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:44.381127 9374 raft_consensus.cc:729] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a467bd081fee4d298f469f62c8d4cd67, State: Initialized, Role: FOLLOWER
I20260808 17:50:44.381167 9374 consensus_queue.cc:260] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.381392 9380 ts_tablet_manager.cc:1428] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:44.381604 9374 ts_tablet_manager.cc:1428] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:44.413574 9456 raft_consensus.cc:482] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:50:44.413653 9456 raft_consensus.cc:504] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.413798 9456 leader_election.cc:288] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9387bfa05a614e9c91db94802a928ba2 (127.28.213.129:37049), 3996c5c9c8ef45339daea70fc3aa3b26 (127.28.213.131:40233)
I20260808 17:50:44.413967 9260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a14b5a3ad6f4e0bbf7f3d49d8897fb8" candidate_uuid: "a467bd081fee4d298f469f62c8d4cd67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" is_pre_election: true
I20260808 17:50:44.413996 8805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a14b5a3ad6f4e0bbf7f3d49d8897fb8" candidate_uuid: "a467bd081fee4d298f469f62c8d4cd67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9387bfa05a614e9c91db94802a928ba2" is_pre_election: true
I20260808 17:50:44.414052 9260 raft_consensus.cc:2454] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a467bd081fee4d298f469f62c8d4cd67 in term 0.
I20260808 17:50:44.414064 8805 raft_consensus.cc:2454] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a467bd081fee4d298f469f62c8d4cd67 in term 0.
I20260808 17:50:44.414193 8922 leader_election.cc:302] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9387bfa05a614e9c91db94802a928ba2, a467bd081fee4d298f469f62c8d4cd67; no voters:
I20260808 17:50:44.414274 9456 raft_consensus.cc:2781] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:50:44.414299 9456 raft_consensus.cc:482] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:50:44.414314 9456 raft_consensus.cc:3037] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:44.414916 9456 raft_consensus.cc:504] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.415031 9456 leader_election.cc:288] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [CANDIDATE]: Term 1 election: Requested vote from peers 9387bfa05a614e9c91db94802a928ba2 (127.28.213.129:37049), 3996c5c9c8ef45339daea70fc3aa3b26 (127.28.213.131:40233)
I20260808 17:50:44.415190 8805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a14b5a3ad6f4e0bbf7f3d49d8897fb8" candidate_uuid: "a467bd081fee4d298f469f62c8d4cd67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9387bfa05a614e9c91db94802a928ba2"
I20260808 17:50:44.415190 9260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a14b5a3ad6f4e0bbf7f3d49d8897fb8" candidate_uuid: "a467bd081fee4d298f469f62c8d4cd67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3996c5c9c8ef45339daea70fc3aa3b26"
I20260808 17:50:44.415246 9260 raft_consensus.cc:3037] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:44.415246 8805 raft_consensus.cc:3037] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:44.415947 9260 raft_consensus.cc:2454] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a467bd081fee4d298f469f62c8d4cd67 in term 1.
I20260808 17:50:44.415956 8805 raft_consensus.cc:2454] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a467bd081fee4d298f469f62c8d4cd67 in term 1.
I20260808 17:50:44.416113 8917 leader_election.cc:302] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3996c5c9c8ef45339daea70fc3aa3b26, 9387bfa05a614e9c91db94802a928ba2, a467bd081fee4d298f469f62c8d4cd67; no voters:
I20260808 17:50:44.416209 9456 raft_consensus.cc:2781] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:44.416246 9456 raft_consensus.cc:686] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [term 1 LEADER]: Becoming Leader. State: Replica: a467bd081fee4d298f469f62c8d4cd67, State: Running, Role: LEADER
I20260808 17:50:44.416285 9456 consensus_queue.cc:237] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.416775 8554 catalog_manager.cc:5495] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 reported cstate change: term changed from 0 to 1, leader changed from <none> to a467bd081fee4d298f469f62c8d4cd67 (127.28.213.130). New cstate: current_term: 1 leader_uuid: "a467bd081fee4d298f469f62c8d4cd67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } health_report { overall_health: UNKNOWN } } }
I20260808 17:50:44.423108 9373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.421060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57332 (local address 127.28.213.130:33437)
0808 17:50:44.421096 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:44.421098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:44.421108 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:50:44.421168 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:44.421169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:44.421179 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:44.421240 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:44.421340 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.421800 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.422521 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.422717 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.422769 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.422894 (+ 125us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:44.422927 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:44.422969 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:44.423024 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 17:50:44.423043 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:50:44.423681 9260 raft_consensus.cc:1261] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 FOLLOWER]: Refusing update from remote peer a467bd081fee4d298f469f62c8d4cd67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:44.423705 8805 raft_consensus.cc:1261] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2 [term 1 FOLLOWER]: Refusing update from remote peer a467bd081fee4d298f469f62c8d4cd67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:44.423889 9381 consensus_queue.cc:1035] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:44.424101 9381 consensus_queue.cc:1035] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:44.427278 8554 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:44.427357 8554 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:44.427856 8554 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23: Sending DeleteTablet for 3 replicas of tablet 5a14b5a3ad6f4e0bbf7f3d49d8897fb8
I20260808 17:50:44.428097 8776 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:44 UTC) from {username='oryx', principal='oryx/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:49580
I20260808 17:50:44.428189 9000 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:44 UTC) from {username='oryx', principal='oryx/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:57328
I20260808 17:50:44.428201 9409 tablet_replica.cc:330] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2: stopping tablet replica
I20260808 17:50:44.428262 9415 tablet_replica.cc:330] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67: stopping tablet replica
I20260808 17:50:44.428262 9230 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:44 UTC) from {username='oryx', principal='oryx/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:45048
I20260808 17:50:44.428273 9409 raft_consensus.cc:2229] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:44.428313 9409 raft_consensus.cc:2258] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:44.428321 9415 raft_consensus.cc:2229] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:50:44.428325 9412 tablet_replica.cc:330] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26: stopping tablet replica
I20260808 17:50:44.428365 9412 raft_consensus.cc:2229] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:44.428372 9415 raft_consensus.cc:2258] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:44.428395 9412 raft_consensus.cc:2258] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:44.428798 9415 ts_tablet_manager.cc:1905] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:44.428834 8554 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54046:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:50:44.428949 8554 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:50:44.430119 8776 tablet_service.cc:1467] Processing CreateTablet for tablet b50a34796a62444290352cc1722956e3 (DEFAULT_TABLE table=test-table [id=ac380ca7b12d4f4b9aa514272936e98e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:44.430226 8776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b50a34796a62444290352cc1722956e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:44.430231 9415 ts_tablet_manager.cc:1918] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:50:44.430271 9415 log.cc:1196] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/5a14b5a3ad6f4e0bbf7f3d49d8897fb8
I20260808 17:50:44.430455 9415 ts_tablet_manager.cc:1939] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P a467bd081fee4d298f469f62c8d4cd67: Deleting consensus metadata
I20260808 17:50:44.430950 9412 ts_tablet_manager.cc:1905] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:44.431457 9375 tablet_bootstrap.cc:492] T b50a34796a62444290352cc1722956e3 P 9387bfa05a614e9c91db94802a928ba2: Bootstrap starting.
I20260808 17:50:44.432128 9375 tablet_bootstrap.cc:654] T b50a34796a62444290352cc1722956e3 P 9387bfa05a614e9c91db94802a928ba2: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:44.432307 9412 ts_tablet_manager.cc:1918] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:50:44.432351 9412 log.cc:1196] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/5a14b5a3ad6f4e0bbf7f3d49d8897fb8
I20260808 17:50:44.432538 9412 ts_tablet_manager.cc:1939] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 3996c5c9c8ef45339daea70fc3aa3b26: Deleting consensus metadata
I20260808 17:50:44.432789 8532 catalog_manager.cc:4841] TS a467bd081fee4d298f469f62c8d4cd67 (127.28.213.130:33437): tablet 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 (table test-table [id=5c9002daf6294ce9aa8d996dc402d53f]) successfully deleted
I20260808 17:50:44.432853 8532 catalog_manager.cc:4841] TS 3996c5c9c8ef45339daea70fc3aa3b26 (127.28.213.131:40233): tablet 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 (table test-table [id=5c9002daf6294ce9aa8d996dc402d53f]) successfully deleted
I20260808 17:50:44.432896 9230 tablet_service.cc:1467] Processing CreateTablet for tablet b50a34796a62444290352cc1722956e3 (DEFAULT_TABLE table=test-table [id=ac380ca7b12d4f4b9aa514272936e98e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:44.432996 9230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b50a34796a62444290352cc1722956e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:44.433683 9375 tablet_bootstrap.cc:492] T b50a34796a62444290352cc1722956e3 P 9387bfa05a614e9c91db94802a928ba2: No bootstrap required, opened a new log
I20260808 17:50:44.433730 9375 ts_tablet_manager.cc:1397] T b50a34796a62444290352cc1722956e3 P 9387bfa05a614e9c91db94802a928ba2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 17:50:44.433854 9375 raft_consensus.cc:348] T b50a34796a62444290352cc1722956e3 P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.433907 9375 raft_consensus.cc:374] T b50a34796a62444290352cc1722956e3 P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:44.433925 9375 raft_consensus.cc:729] T b50a34796a62444290352cc1722956e3 P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9387bfa05a614e9c91db94802a928ba2, State: Initialized, Role: FOLLOWER
I20260808 17:50:44.433964 9375 consensus_queue.cc:260] T b50a34796a62444290352cc1722956e3 P 9387bfa05a614e9c91db94802a928ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.434042 9375 ts_tablet_manager.cc:1428] T b50a34796a62444290352cc1722956e3 P 9387bfa05a614e9c91db94802a928ba2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:44.434103 9380 tablet_bootstrap.cc:492] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26: Bootstrap starting.
I20260808 17:50:44.434377 9380 tablet_bootstrap.cc:654] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:44.434947 9000 tablet_service.cc:1467] Processing CreateTablet for tablet b50a34796a62444290352cc1722956e3 (DEFAULT_TABLE table=test-table [id=ac380ca7b12d4f4b9aa514272936e98e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:50:44.435045 9000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b50a34796a62444290352cc1722956e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:44.435771 9374 tablet_bootstrap.cc:492] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67: Bootstrap starting.
I20260808 17:50:44.436089 9409 ts_tablet_manager.cc:1905] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:44.436151 9374 tablet_bootstrap.cc:654] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:44.436993 9374 tablet_bootstrap.cc:492] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67: No bootstrap required, opened a new log
I20260808 17:50:44.437038 9374 ts_tablet_manager.cc:1397] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:44.437165 9374 raft_consensus.cc:348] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.437248 9374 raft_consensus.cc:374] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:44.437270 9374 raft_consensus.cc:729] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a467bd081fee4d298f469f62c8d4cd67, State: Initialized, Role: FOLLOWER
I20260808 17:50:44.437307 9374 consensus_queue.cc:260] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.437387 9374 ts_tablet_manager.cc:1428] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:44.437426 9409 ts_tablet_manager.cc:1918] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:50:44.437467 9409 log.cc:1196] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-0/wal/wals/5a14b5a3ad6f4e0bbf7f3d49d8897fb8
I20260808 17:50:44.437659 9409 ts_tablet_manager.cc:1939] T 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 P 9387bfa05a614e9c91db94802a928ba2: Deleting consensus metadata
I20260808 17:50:44.437958 8535 catalog_manager.cc:4841] TS 9387bfa05a614e9c91db94802a928ba2 (127.28.213.129:37049): tablet 5a14b5a3ad6f4e0bbf7f3d49d8897fb8 (table test-table [id=5c9002daf6294ce9aa8d996dc402d53f]) successfully deleted
I20260808 17:50:44.438274 9380 tablet_bootstrap.cc:492] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26: No bootstrap required, opened a new log
I20260808 17:50:44.438319 9380 ts_tablet_manager.cc:1397] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.000s
I20260808 17:50:44.438407 9380 raft_consensus.cc:348] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.438467 9380 raft_consensus.cc:374] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:44.438491 9380 raft_consensus.cc:729] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3996c5c9c8ef45339daea70fc3aa3b26, State: Initialized, Role: FOLLOWER
I20260808 17:50:44.438526 9380 consensus_queue.cc:260] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.438607 9380 ts_tablet_manager.cc:1428] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:44.476864 9388 raft_consensus.cc:482] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:50:44.476949 9388 raft_consensus.cc:504] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.477102 9388 leader_election.cc:288] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9387bfa05a614e9c91db94802a928ba2 (127.28.213.129:37049), a467bd081fee4d298f469f62c8d4cd67 (127.28.213.130:33437)
I20260808 17:50:44.477277 8805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b50a34796a62444290352cc1722956e3" candidate_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9387bfa05a614e9c91db94802a928ba2" is_pre_election: true
I20260808 17:50:44.477304 9032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b50a34796a62444290352cc1722956e3" candidate_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a467bd081fee4d298f469f62c8d4cd67" is_pre_election: true
I20260808 17:50:44.477360 8805 raft_consensus.cc:2454] T b50a34796a62444290352cc1722956e3 P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3996c5c9c8ef45339daea70fc3aa3b26 in term 0.
I20260808 17:50:44.477372 9032 raft_consensus.cc:2454] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3996c5c9c8ef45339daea70fc3aa3b26 in term 0.
I20260808 17:50:44.477499 9149 leader_election.cc:302] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3996c5c9c8ef45339daea70fc3aa3b26, 9387bfa05a614e9c91db94802a928ba2; no voters:
I20260808 17:50:44.477720 9388 raft_consensus.cc:2781] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:50:44.477757 9388 raft_consensus.cc:482] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:50:44.477775 9388 raft_consensus.cc:3037] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:44.478508 9388 raft_consensus.cc:504] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.478623 9388 leader_election.cc:288] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [CANDIDATE]: Term 1 election: Requested vote from peers 9387bfa05a614e9c91db94802a928ba2 (127.28.213.129:37049), a467bd081fee4d298f469f62c8d4cd67 (127.28.213.130:33437)
I20260808 17:50:44.478785 8805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b50a34796a62444290352cc1722956e3" candidate_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9387bfa05a614e9c91db94802a928ba2"
I20260808 17:50:44.478816 9032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b50a34796a62444290352cc1722956e3" candidate_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a467bd081fee4d298f469f62c8d4cd67"
I20260808 17:50:44.478853 8805 raft_consensus.cc:3037] T b50a34796a62444290352cc1722956e3 P 9387bfa05a614e9c91db94802a928ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:44.478868 9032 raft_consensus.cc:3037] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:44.479543 8805 raft_consensus.cc:2454] T b50a34796a62444290352cc1722956e3 P 9387bfa05a614e9c91db94802a928ba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3996c5c9c8ef45339daea70fc3aa3b26 in term 1.
I20260808 17:50:44.479543 9032 raft_consensus.cc:2454] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3996c5c9c8ef45339daea70fc3aa3b26 in term 1.
I20260808 17:50:44.479696 9149 leader_election.cc:302] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3996c5c9c8ef45339daea70fc3aa3b26, 9387bfa05a614e9c91db94802a928ba2; no voters:
I20260808 17:50:44.479862 9388 raft_consensus.cc:2781] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:44.479911 9388 raft_consensus.cc:686] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 LEADER]: Becoming Leader. State: Replica: 3996c5c9c8ef45339daea70fc3aa3b26, State: Running, Role: LEADER
I20260808 17:50:44.479955 9388 consensus_queue.cc:237] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } }
I20260808 17:50:44.480454 8554 catalog_manager.cc:5495] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3996c5c9c8ef45339daea70fc3aa3b26 (127.28.213.131). New cstate: current_term: 1 leader_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3996c5c9c8ef45339daea70fc3aa3b26" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40233 } health_report { overall_health: HEALTHY } } }
I20260808 17:50:44.497144 9366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.495093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45058 (local address 127.28.213.131:40233)
0808 17:50:44.495139 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:44.495140 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:44.495147 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:50:44.495167 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:44.495168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:44.495178 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:44.495220 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:44.495336 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.495883 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.496562 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.496758 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.496809 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.496941 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:44.496973 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:44.497009 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:44.497059 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 17:50:44.497079 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:50:44.501056 9368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.499209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:34617 (local address 127.28.213.129:37049)
0808 17:50:44.499245 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:44.499247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:44.499312 (+ 65us) server_negotiation.cc:407] Connection header received
0808 17:50:44.499371 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:44.499372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:44.499379 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:44.499416 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:44.499495 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.499923 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.500591 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.500756 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.500797 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.500904 (+ 107us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:44.500933 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:44.500963 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:44.500993 (+ 30us) server_negotiation.cc:299] Negotiation successful
0808 17:50:44.501009 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 17:50:44.501076 9507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.499142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:37049 (local address 127.28.213.131:34617)
0808 17:50:44.499258 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:44.499268 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:44.499322 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:44.499417 (+ 95us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:44.499417 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:44.499419 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:50:44.499457 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.499458 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.499972 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.499972 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.500538 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.500539 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.500806 (+ 267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.500807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.500841 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.500853 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:50:44.500962 (+ 109us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:50:44.500963 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 17:50:44.500990 (+ 27us) client_negotiation.cc:240] Negotiation successful
0808 17:50:44.501020 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":37,"threads_started":1}
I20260808 17:50:44.502928 9032 raft_consensus.cc:1261] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67 [term 1 FOLLOWER]: Refusing update from remote peer 3996c5c9c8ef45339daea70fc3aa3b26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:44.502938 8805 raft_consensus.cc:1261] T b50a34796a62444290352cc1722956e3 P 9387bfa05a614e9c91db94802a928ba2 [term 1 FOLLOWER]: Refusing update from remote peer 3996c5c9c8ef45339daea70fc3aa3b26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:50:44.503116 9385 consensus_queue.cc:1035] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9387bfa05a614e9c91db94802a928ba2" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:44.503219 9388 consensus_queue.cc:1035] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a467bd081fee4d298f469f62c8d4cd67" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:50:44.509646 9366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.507555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:58603 (local address 127.28.213.131:40233)
0808 17:50:44.507598 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:44.507600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:44.507607 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:50:44.507624 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:44.507625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:44.507632 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:44.507675 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:50:44.507770 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.508206 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.508957 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.509256 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.509309 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.509445 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:50:44.509477 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:50:44.509524 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:44.509580 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 17:50:44.509599 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:50:44.509670 9460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.507413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:40233 (local address 127.28.213.129:58603)
0808 17:50:44.507460 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:44.507470 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:44.507506 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:44.507686 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:44.507687 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:44.507688 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 17:50:44.507725 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.507727 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.508272 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.508273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.508880 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:44.508882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:44.509321 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:44.509322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:44.509381 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:44.509387 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 17:50:44.509529 (+ 142us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 17:50:44.509532 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:50:44.509577 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 17:50:44.509621 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 17:50:44.515117 8554 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:44.515195 8554 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:50:44.515699 8554 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f829a740d0fa42f489e3683acc660f23: Sending DeleteTablet for 3 replicas of tablet b50a34796a62444290352cc1722956e3
I20260808 17:50:44.515902 8776 tablet_service.cc:1514] Processing DeleteTablet for tablet b50a34796a62444290352cc1722956e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:44 UTC) from {username='oryx', principal='oryx/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:49580
I20260808 17:50:44.515933 9000 tablet_service.cc:1514] Processing DeleteTablet for tablet b50a34796a62444290352cc1722956e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:44 UTC) from {username='oryx', principal='oryx/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:57328
I20260808 17:50:44.515960 9230 tablet_service.cc:1514] Processing DeleteTablet for tablet b50a34796a62444290352cc1722956e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:50:44 UTC) from {username='oryx', principal='oryx/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:45048
I20260808 17:50:44.516036 9409 tablet_replica.cc:330] T b50a34796a62444290352cc1722956e3 P 9387bfa05a614e9c91db94802a928ba2: stopping tablet replica
I20260808 17:50:44.516098 9409 raft_consensus.cc:2229] T b50a34796a62444290352cc1722956e3 P 9387bfa05a614e9c91db94802a928ba2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:44.516136 9409 raft_consensus.cc:2258] T b50a34796a62444290352cc1722956e3 P 9387bfa05a614e9c91db94802a928ba2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:44.516204 9415 tablet_replica.cc:330] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67: stopping tablet replica
I20260808 17:50:44.516235 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 8678
I20260808 17:50:44.516260 9415 raft_consensus.cc:2229] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:50:44.516294 9415 raft_consensus.cc:2258] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:44.516361 9412 tablet_replica.cc:330] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26: stopping tablet replica
I20260808 17:50:44.516414 9412 raft_consensus.cc:2229] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:50:44.516458 9412 raft_consensus.cc:2258] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:50:44.522375 9412 ts_tablet_manager.cc:1905] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:44.524120 9412 ts_tablet_manager.cc:1918] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:50:44.524196 9412 log.cc:1196] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/b50a34796a62444290352cc1722956e3
I20260808 17:50:44.524475 9412 ts_tablet_manager.cc:1939] T b50a34796a62444290352cc1722956e3 P 3996c5c9c8ef45339daea70fc3aa3b26: Deleting consensus metadata
I20260808 17:50:44.524725 9415 ts_tablet_manager.cc:1905] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:50:44.525869 9415 ts_tablet_manager.cc:1918] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 17:50:44.525920 9415 log.cc:1196] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/b50a34796a62444290352cc1722956e3
I20260808 17:50:44.526086 9415 ts_tablet_manager.cc:1939] T b50a34796a62444290352cc1722956e3 P a467bd081fee4d298f469f62c8d4cd67: Deleting consensus metadata
I20260808 17:50:44.529275 8532 catalog_manager.cc:4841] TS a467bd081fee4d298f469f62c8d4cd67 (127.28.213.130:33437): tablet b50a34796a62444290352cc1722956e3 (table test-table [id=ac380ca7b12d4f4b9aa514272936e98e]) successfully deleted
I20260808 17:50:44.529354 8532 catalog_manager.cc:4841] TS 3996c5c9c8ef45339daea70fc3aa3b26 (127.28.213.131:40233): tablet b50a34796a62444290352cc1722956e3 (table test-table [id=ac380ca7b12d4f4b9aa514272936e98e]) successfully deleted
W20260808 17:50:44.530498 8535 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.213.129:37049 (error 108)
I20260808 17:50:44.530755 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 8889
I20260808 17:50:44.537372 9515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:44.530804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:37049 (local address 127.0.0.1:49596)
0808 17:50:44.537296 (+ 6492us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:44.537340 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.129:37049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6475,"thread_start_us":49,"threads_started":1}
W20260808 17:50:44.537480 8535 catalog_manager.cc:4584] TS 9387bfa05a614e9c91db94802a928ba2 (127.28.213.129:37049): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b50a34796a62444290352cc1722956e3: Network error: Client connection negotiation failed: client connection to 127.28.213.129:37049: connect: Connection refused (error 111)
I20260808 17:50:44.542732 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 9122
I20260808 17:50:44.556003 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 8503
2026-08-08T17:50:44Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2442 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:50:44 dist-test-slave-bndk krb5kdc[9519](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:50:44 dist-test-slave-bndk krb5kdc[9519](info): set up 2 sockets
Aug 08 17:50:44 dist-test-slave-bndk krb5kdc[9519](info): commencing operation
krb5kdc: starting...
W20260808 17:50:45.689189 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:50:45 dist-test-slave-bndk krb5kdc[9519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:50:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:50:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:50:45.797550 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:45569
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:45021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:45569
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:45.876147 9542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:45.876335 9542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:45.876355 9542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:45.877498 9542 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:45.877537 9542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:45.877550 9542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:45.877574 9542 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:45.877597 9542 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:50:45.879024 9542 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:45021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:45569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:45569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:45.879246 9542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:45.879474 9542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:45.883846 9551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:45.883884 9552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:45.883843 9555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:45.884274 9542 server_base.cc:1034] running on GCE node
I20260808 17:50:45.884501 9542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:45.884774 9542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:45.885910 9542 hybrid_clock.cc:648] HybridClock initialized: now 1786211445885891 us; error 28 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T17:50:45Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1332 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:50:45 dist-test-slave-bndk krb5kdc[9565](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:50:45 dist-test-slave-bndk krb5kdc[9565](info): set up 2 sockets
Aug 08 17:50:45 dist-test-slave-bndk krb5kdc[9565](info): commencing operation
krb5kdc: starting...
W20260808 17:50:47.010150 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:50:47 dist-test-slave-bndk krb5kdc[9565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211447, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:50:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:50:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:50:47.117599 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:40999
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:40999
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:47.195328 9583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:47.195529 9583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:47.195561 9583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:47.196664 9583 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:47.196703 9583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:47.196722 9583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:47.196738 9583 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:47.196754 9583 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:50:47.198235 9583 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:40999
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:40999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:47.198483 9583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:47.198686 9583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:47.203153 9595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:47.203127 9591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:47.203137 9592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:47.203353 9583 server_base.cc:1034] running on GCE node
I20260808 17:50:47.203583 9583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:47.203836 9583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:47.205006 9583 hybrid_clock.cc:648] HybridClock initialized: now 1786211447204994 us; error 31 us; skew 500 ppm
Aug 08 17:50:47 dist-test-slave-bndk krb5kdc[9565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211447, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:47.207378 9583 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:50:47.207764 9583 webserver.cc:460] Webserver started at http://127.28.213.190:37803/ using document root <none> and password file <none>
I20260808 17:50:47.207965 9583 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:47.208014 9583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:47.208140 9583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:47.209146 9583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "c529b2fffaf04ddca7ee941c74d411ed"
format_stamp: "Formatted at 2026-08-08 17:50:47 on dist-test-slave-bndk"
server_key: "54acd4f4a81b72fb3c39dbab11e7e476"
server_key_iv: "493aac3190fc11d18ab08e7d00d38351"
server_key_version: "encryptionkey@0"
I20260808 17:50:47.209527 9583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "c529b2fffaf04ddca7ee941c74d411ed"
format_stamp: "Formatted at 2026-08-08 17:50:47 on dist-test-slave-bndk"
server_key: "54acd4f4a81b72fb3c39dbab11e7e476"
server_key_iv: "493aac3190fc11d18ab08e7d00d38351"
server_key_version: "encryptionkey@0"
I20260808 17:50:47.210718 9583 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:47.211426 9603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:47.211580 9583 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:47.211663 9583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "c529b2fffaf04ddca7ee941c74d411ed"
format_stamp: "Formatted at 2026-08-08 17:50:47 on dist-test-slave-bndk"
server_key: "54acd4f4a81b72fb3c39dbab11e7e476"
server_key_iv: "493aac3190fc11d18ab08e7d00d38351"
server_key_version: "encryptionkey@0"
I20260808 17:50:47.211730 9583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:47.230885 9583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:47.232559 9583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:47.232689 9583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:47.236395 9583 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:40999
I20260808 17:50:47.236441 9685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:40999 every 8 connection(s)
I20260808 17:50:47.236742 9583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:50:47.237622 9687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:50:47.239802 9687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed: Bootstrap starting.
I20260808 17:50:47.240334 9687 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed: Neither blocks nor log segments found. Creating new log.
I20260808 17:50:47.240576 9687 log.cc:824] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:47.241181 9687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed: No bootstrap required, opened a new log
I20260808 17:50:47.241601 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 9583
I20260808 17:50:47.241698 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:50:47.241885 29526 external_mini_cluster.cc:1428] Setting key 7e86fede823158d11613f1813bcdce5c
I20260808 17:50:47.243059 9687 raft_consensus.cc:348] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c529b2fffaf04ddca7ee941c74d411ed" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40999 } }
I20260808 17:50:47.243206 9687 raft_consensus.cc:374] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:50:47.243243 9687 raft_consensus.cc:729] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c529b2fffaf04ddca7ee941c74d411ed, State: Initialized, Role: FOLLOWER
I20260808 17:50:47.243369 9687 consensus_queue.cc:260] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c529b2fffaf04ddca7ee941c74d411ed" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40999 } }
I20260808 17:50:47.243462 9687 raft_consensus.cc:388] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:50:47.243501 9687 raft_consensus.cc:482] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:50:47.243547 9687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:50:47.244462 9687 raft_consensus.cc:504] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c529b2fffaf04ddca7ee941c74d411ed" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40999 } }
I20260808 17:50:47.244563 9687 leader_election.cc:302] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c529b2fffaf04ddca7ee941c74d411ed; no voters:
I20260808 17:50:47.244714 9687 leader_election.cc:288] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:50:47.244756 9696 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:50:47.244904 9696 raft_consensus.cc:686] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [term 1 LEADER]: Becoming Leader. State: Replica: c529b2fffaf04ddca7ee941c74d411ed, State: Running, Role: LEADER
I20260808 17:50:47.244967 9687 sys_catalog.cc:564] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:47.245064 9696 consensus_queue.cc:237] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c529b2fffaf04ddca7ee941c74d411ed" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40999 } }
I20260808 17:50:47.245445 9696 sys_catalog.cc:455] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader c529b2fffaf04ddca7ee941c74d411ed. Latest consensus state: current_term: 1 leader_uuid: "c529b2fffaf04ddca7ee941c74d411ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c529b2fffaf04ddca7ee941c74d411ed" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40999 } } }
I20260808 17:50:47.245525 9696 sys_catalog.cc:458] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:47.245491 9700 sys_catalog.cc:455] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c529b2fffaf04ddca7ee941c74d411ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c529b2fffaf04ddca7ee941c74d411ed" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40999 } } }
I20260808 17:50:47.245568 9700 sys_catalog.cc:458] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:47.245844 9707 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:50:47.246325 9707 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:50:47.248570 9707 catalog_manager.cc:1347] Generated new cluster ID: aa2917659cf94b6191d6d6e27dec25e9
Aug 08 17:50:47 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211447, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:47.248613 9707 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:50:47.252660 9694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:47.242330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56796 (local address 127.28.213.190:40999)
0808 17:50:47.242501 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:47.242508 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:47.242532 (+ 24us) server_negotiation.cc:407] Connection header received
0808 17:50:47.243025 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:47.243030 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:47.243073 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:47.243176 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:47.243976 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:47.245017 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:47.246035 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:47.246644 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:47.246778 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:47.249128 (+ 2350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:47.249132 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:47.249133 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:47.249143 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:47.251002 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:47.251392 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:47.251394 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:47.251395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:47.251512 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:47.251704 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:47.251705 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:47.251705 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:47.251969 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:47.252105 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:47.252232 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 17:50:47.252468 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":72,"threads_started":1}
I20260808 17:50:47.253582 9707 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:50:47.254222 9707 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:50:47.258462 9707 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed: Generated new TSK 0
I20260808 17:50:47.258603 9707 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
I20260808 17:50:47.281870 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:40999
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:47.361641 9729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:47.361826 9729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:47.361847 9729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:47.362952 9729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:47.362991 9729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:47.363015 9729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:50:47.364390 9729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:40999
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:47.364598 9729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:47.364805 9729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:47.369442 9742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:47.369431 9735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:47.369431 9738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:47.369508 9729 server_base.cc:1034] running on GCE node
I20260808 17:50:47.369787 9729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:47.370026 9729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:47.371166 9729 hybrid_clock.cc:648] HybridClock initialized: now 1786211447371154 us; error 25 us; skew 500 ppm
Aug 08 17:50:47 dist-test-slave-bndk krb5kdc[9565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211447, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:47.373553 9729 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:50:47.373965 9729 webserver.cc:460] Webserver started at http://127.28.213.129:43137/ using document root <none> and password file <none>
I20260808 17:50:47.374181 9729 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:47.374223 9729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:47.374366 9729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:47.375345 9729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "7fd2faf55a914c6983b789fbebed73bf"
format_stamp: "Formatted at 2026-08-08 17:50:47 on dist-test-slave-bndk"
server_key: "7c6686d552e5268aab7d22cd040073d8"
server_key_iv: "281122b8b1c582a129057eb50f821a6e"
server_key_version: "encryptionkey@0"
I20260808 17:50:47.375663 9729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "7fd2faf55a914c6983b789fbebed73bf"
format_stamp: "Formatted at 2026-08-08 17:50:47 on dist-test-slave-bndk"
server_key: "7c6686d552e5268aab7d22cd040073d8"
server_key_iv: "281122b8b1c582a129057eb50f821a6e"
server_key_version: "encryptionkey@0"
I20260808 17:50:47.376893 9729 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:50:47.377555 9756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:47.377703 9729 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:47.377785 9729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "7fd2faf55a914c6983b789fbebed73bf"
format_stamp: "Formatted at 2026-08-08 17:50:47 on dist-test-slave-bndk"
server_key: "7c6686d552e5268aab7d22cd040073d8"
server_key_iv: "281122b8b1c582a129057eb50f821a6e"
server_key_version: "encryptionkey@0"
I20260808 17:50:47.377846 9729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:47.401887 9729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:47.403573 9729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:47.403703 9729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:47.403910 9729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:47.404199 9729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:47.404232 9729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:47.404259 9729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:47.404285 9729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:47.409698 9729 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:43491
I20260808 17:50:47.409754 9927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:43491 every 8 connection(s)
I20260808 17:50:47.410028 9729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
Aug 08 17:50:47 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211447, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:47.416289 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 9729
I20260808 17:50:47.416388 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:50:47.416563 29526 external_mini_cluster.cc:1428] Setting key 564cacff78cf0ca0815708e72e2a59f2
I20260808 17:50:47.418512 9694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:47.410688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:43447 (local address 127.28.213.190:40999)
0808 17:50:47.410735 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:47.410737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:47.410923 (+ 186us) server_negotiation.cc:407] Connection header received
0808 17:50:47.411395 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:47.411396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:47.411413 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:47.411467 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:47.412302 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:47.412788 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:47.413761 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:47.413979 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:47.414026 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:47.415963 (+ 1937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:47.415964 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:47.415965 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:47.415971 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:47.417271 (+ 1300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:47.417686 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:47.417687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:47.417687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:47.417733 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:47.417969 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:47.417969 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:47.417970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:47.418061 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:47.418105 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:47.418382 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 17:50:47.418451 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:50:47.418711 9931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:47.410647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.129:43447)
0808 17:50:47.410798 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:47.410840 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:47.411309 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:47.411518 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:47.411522 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:47.412052 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:47.412235 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:47.412240 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:47.412850 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:47.412851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:47.413693 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:47.413697 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:47.414045 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:47.414046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:47.414144 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:47.414522 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:47.414529 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:47.415884 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:47.417360 (+ 1476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:47.417368 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:47.417370 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:47.417622 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:47.417788 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:47.417788 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:47.417789 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:47.417917 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:47.418111 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:47.418116 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:47.418256 (+ 140us) client_negotiation.cc:769] Sending connection context
0808 17:50:47.418361 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 17:50:47.418510 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":81,"threads_started":1}
I20260808 17:50:47.419324 9928 heartbeater.cc:347] Connected to a master server at 127.28.213.190:40999
I20260808 17:50:47.419406 9928 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:47.419564 9928 heartbeater.cc:511] Master 127.28.213.190:40999 requested a full tablet report, sending...
I20260808 17:50:47.420030 9628 ts_manager.cc:194] Registered new tserver with Master: 7fd2faf55a914c6983b789fbebed73bf (127.28.213.129:43491)
I20260808 17:50:47.420604 9628 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:43447
WARNING: no policy specified for kudu/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
I20260808 17:50:47.439241 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:40999
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:47.517005 9935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:47.517185 9935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:47.517206 9935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:47.518325 9935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:47.518366 9935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:47.518395 9935 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:50:47.519769 9935 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:40999
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:47.519982 9935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:47.520186 9935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 17:50:47.524652 9935 server_base.cc:1034] running on GCE node
W20260808 17:50:47.524662 9952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:47.524636 9955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:47.524629 9948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:47.525045 9935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:47.525250 9935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:47.526393 9935 hybrid_clock.cc:648] HybridClock initialized: now 1786211447526372 us; error 36 us; skew 500 ppm
Aug 08 17:50:47 dist-test-slave-bndk krb5kdc[9565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211447, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:47.528632 9935 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:50:47.529048 9935 webserver.cc:460] Webserver started at http://127.28.213.130:37513/ using document root <none> and password file <none>
I20260808 17:50:47.529286 9935 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:47.529336 9935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:47.529453 9935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:47.530530 9935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "8ca2f01989a2412eb87f87be8dc72959"
format_stamp: "Formatted at 2026-08-08 17:50:47 on dist-test-slave-bndk"
server_key: "8f2a6296bd300503639e9b8f0f4d4572"
server_key_iv: "fa11dfa2dac0ebee148bef2160c91dac"
server_key_version: "encryptionkey@0"
I20260808 17:50:47.530912 9935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "8ca2f01989a2412eb87f87be8dc72959"
format_stamp: "Formatted at 2026-08-08 17:50:47 on dist-test-slave-bndk"
server_key: "8f2a6296bd300503639e9b8f0f4d4572"
server_key_iv: "fa11dfa2dac0ebee148bef2160c91dac"
server_key_version: "encryptionkey@0"
I20260808 17:50:47.532477 9935 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:50:47.533233 9964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:47.533380 9935 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:47.533463 9935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "8ca2f01989a2412eb87f87be8dc72959"
format_stamp: "Formatted at 2026-08-08 17:50:47 on dist-test-slave-bndk"
server_key: "8f2a6296bd300503639e9b8f0f4d4572"
server_key_iv: "fa11dfa2dac0ebee148bef2160c91dac"
server_key_version: "encryptionkey@0"
I20260808 17:50:47.533530 9935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:47.551316 9935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:47.552816 9935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:47.552942 9935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:47.553124 9935 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:47.553416 9935 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:47.553452 9935 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:47.553478 9935 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:47.553493 9935 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:47.558707 9935 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:44759
I20260808 17:50:47.558743 10137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:44759 every 8 connection(s)
I20260808 17:50:47.559010 9935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:50:47.563316 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 9935
I20260808 17:50:47.563438 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:50:47.563648 29526 external_mini_cluster.cc:1428] Setting key a50048bc971a2f2949b4b1a525676f58
Aug 08 17:50:47 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211447, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:47.567776 9694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:47.559657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:34077 (local address 127.28.213.190:40999)
0808 17:50:47.559716 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:47.559719 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:47.559882 (+ 163us) server_negotiation.cc:407] Connection header received
0808 17:50:47.560320 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:47.560321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:47.560334 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:47.560382 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:47.561261 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:47.561754 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:47.562699 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:47.562893 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:47.562956 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:47.565246 (+ 2290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:47.565248 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:47.565248 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:47.565256 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:47.566536 (+ 1280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:47.566901 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:47.566903 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:47.566903 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:47.566964 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:47.567179 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:47.567180 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:47.567181 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:47.567294 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:47.567359 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:47.567595 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 17:50:47.567678 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 17:50:47.567925 10141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:47.559612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.130:34077)
0808 17:50:47.559775 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:47.559809 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:47.560227 (+ 418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:47.560467 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:47.560471 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:47.560993 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:47.561159 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:47.561164 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:47.561836 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:47.561837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:47.562610 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:47.562613 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:47.562968 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:47.562969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:47.563093 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:47.563575 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:47.563585 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:47.565134 (+ 1549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:47.566612 (+ 1478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:47.566619 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:47.566622 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:47.566823 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:47.567018 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:47.567019 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:47.567019 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:47.567114 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:47.567350 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:47.567356 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:47.567478 (+ 122us) client_negotiation.cc:769] Sending connection context
0808 17:50:47.567564 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 17:50:47.567710 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":81,"threads_started":1}
I20260808 17:50:47.568382 10139 heartbeater.cc:347] Connected to a master server at 127.28.213.190:40999
I20260808 17:50:47.568470 10139 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:47.568634 10139 heartbeater.cc:511] Master 127.28.213.190:40999 requested a full tablet report, sending...
I20260808 17:50:47.569028 9628 ts_manager.cc:194] Registered new tserver with Master: 8ca2f01989a2412eb87f87be8dc72959 (127.28.213.130:44759)
I20260808 17:50:47.569559 9628 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:34077
WARNING: no policy specified for kudu/127.28.213.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
I20260808 17:50:47.587102 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:40999
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:47.664978 10146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:47.665159 10146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:47.665180 10146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:47.666314 10146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:47.666354 10146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:47.666381 10146 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:50:47.667755 10146 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:40999
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:47.667963 10146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:47.668151 10146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:47.672569 10157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:47.672582 10154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:47.672731 10146 server_base.cc:1034] running on GCE node
W20260808 17:50:47.672605 10159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:47.672976 10146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:47.673200 10146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:47.674361 10146 hybrid_clock.cc:648] HybridClock initialized: now 1786211447674348 us; error 31 us; skew 500 ppm
Aug 08 17:50:47 dist-test-slave-bndk krb5kdc[9565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211447, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:47.676609 10146 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:50:47.677016 10146 webserver.cc:460] Webserver started at http://127.28.213.131:33399/ using document root <none> and password file <none>
I20260808 17:50:47.677199 10146 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:47.677282 10146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:47.677412 10146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:50:47.678357 10146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "e82a1911958848fc9ea2cf524a8e0116"
format_stamp: "Formatted at 2026-08-08 17:50:47 on dist-test-slave-bndk"
server_key: "5ac22f875f4b67c9b0a759e274954dca"
server_key_iv: "57c7240c15f5ea17b1eb487ae2011b18"
server_key_version: "encryptionkey@0"
I20260808 17:50:47.678676 10146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "e82a1911958848fc9ea2cf524a8e0116"
format_stamp: "Formatted at 2026-08-08 17:50:47 on dist-test-slave-bndk"
server_key: "5ac22f875f4b67c9b0a759e274954dca"
server_key_iv: "57c7240c15f5ea17b1eb487ae2011b18"
server_key_version: "encryptionkey@0"
I20260808 17:50:47.679842 10146 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:50:47.680480 10168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:47.680656 10146 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:47.680724 10146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "e82a1911958848fc9ea2cf524a8e0116"
format_stamp: "Formatted at 2026-08-08 17:50:47 on dist-test-slave-bndk"
server_key: "5ac22f875f4b67c9b0a759e274954dca"
server_key_iv: "57c7240c15f5ea17b1eb487ae2011b18"
server_key_version: "encryptionkey@0"
I20260808 17:50:47.680794 10146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:47.696866 10146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:47.698565 10146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:47.698668 10146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:47.698836 10146 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:47.699079 10146 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:47.699107 10146 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:47.699133 10146 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:47.699149 10146 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:47.704421 10146 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:41447
I20260808 17:50:47.704479 10345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:41447 every 8 connection(s)
I20260808 17:50:47.704752 10146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
Aug 08 17:50:47 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211447, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:50:47.711316 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 10146
I20260808 17:50:47.711428 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:50:47.711627 29526 external_mini_cluster.cc:1428] Setting key 70e805ad75614de39a8d73c85ebf67e0
I20260808 17:50:47.713536 9694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:47.705416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:36541 (local address 127.28.213.190:40999)
0808 17:50:47.705470 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:47.705472 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:47.705637 (+ 165us) server_negotiation.cc:407] Connection header received
0808 17:50:47.706109 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:47.706111 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:47.706124 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:47.706174 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:47.707065 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:47.707556 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:47.708519 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:47.708716 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:47.708773 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:47.710766 (+ 1993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:47.710768 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:47.710768 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:47.710777 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:47.712206 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:47.712622 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:47.712623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:47.712624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:47.712684 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:47.712897 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:47.712898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:47.712898 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:47.713017 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:47.713074 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:47.713366 (+ 292us) server_negotiation.cc:299] Negotiation successful
0808 17:50:47.713446 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 17:50:47.713716 10349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:47.705386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.131:36541)
0808 17:50:47.705525 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:47.705563 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:47.706013 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:47.706241 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:47.706245 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:47.706782 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:47.706966 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:47.706971 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:47.707642 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:47.707643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:47.708434 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:47.708436 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:47.708784 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:47.708786 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:47.708908 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:47.709369 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:47.709378 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:47.710675 (+ 1297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:50:47.712265 (+ 1590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:47.712271 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:47.712274 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:47.712559 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:47.712736 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:50:47.712737 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:50:47.712737 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:50:47.712842 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:50:47.713073 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:50:47.713079 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:50:47.713209 (+ 130us) client_negotiation.cc:769] Sending connection context
0808 17:50:47.713335 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 17:50:47.713513 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":63,"threads_started":1}
I20260808 17:50:47.714133 10347 heartbeater.cc:347] Connected to a master server at 127.28.213.190:40999
I20260808 17:50:47.714210 10347 heartbeater.cc:464] Registering TS with master...
I20260808 17:50:47.714347 10347 heartbeater.cc:511] Master 127.28.213.190:40999 requested a full tablet report, sending...
I20260808 17:50:47.714664 9628 ts_manager.cc:194] Registered new tserver with Master: e82a1911958848fc9ea2cf524a8e0116 (127.28.213.131:41447)
I20260808 17:50:47.715036 9628 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:36541
I20260808 17:50:47.723095 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.129.keytab.
Entry for principal oryx/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.129.keytab.
WARNING: no policy specified for oryx/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.130.keytab.
Entry for principal oryx/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.130.keytab.
WARNING: no policy specified for oryx/127.28.213.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.131.keytab.
Entry for principal oryx/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.131.keytab.
I20260808 17:50:47.784961 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 9729
I20260808 17:50:47.793349 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 9935
I20260808 17:50:47.808349 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 10146
I20260808 17:50:47.816111 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 9583
I20260808 17:50:47.828132 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:40999
--webserver_interface=127.28.213.190
--webserver_port=37803
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:40999
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:50:47.907325 10363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:47.907567 10363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:47.907603 10363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:47.908715 10363 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:50:47.908754 10363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:47.908772 10363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:47.908788 10363 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:50:47.908803 10363 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:50:47.910261 10363 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:40999
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:40999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=37803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10363
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:47.910498 10363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:47.910701 10363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:47.915050 10372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:47.915109 10371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:47.915057 10374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:47.915383 10363 server_base.cc:1034] running on GCE node
I20260808 17:50:47.915597 10363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:47.915841 10363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:47.916973 10363 hybrid_clock.cc:648] HybridClock initialized: now 1786211447916959 us; error 29 us; skew 500 ppm
Aug 08 17:50:47 dist-test-slave-bndk krb5kdc[9565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211447, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:47.919337 10363 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:50:47.919692 10363 webserver.cc:460] Webserver started at http://127.28.213.190:37803/ using document root <none> and password file <none>
I20260808 17:50:47.919871 10363 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:47.919926 10363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:47.921073 10363 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:47.921697 10384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:47.921830 10363 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:47.921919 10363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "c529b2fffaf04ddca7ee941c74d411ed"
format_stamp: "Formatted at 2026-08-08 17:50:47 on dist-test-slave-bndk"
server_key: "54acd4f4a81b72fb3c39dbab11e7e476"
server_key_iv: "493aac3190fc11d18ab08e7d00d38351"
server_key_version: "encryptionkey@0"
I20260808 17:50:47.922241 10363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:47.934623 10363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:47.936506 10363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:47.936631 10363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:47.940299 10363 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:40999
I20260808 17:50:47.940341 10467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:40999 every 8 connection(s)
I20260808 17:50:47.940647 10363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:50:47.941962 10470 sys_catalog.cc:263] Verifying existing consensus state
I20260808 17:50:47.942431 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 10363
I20260808 17:50:47.942576 10470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed: Bootstrap starting.
I20260808 17:50:47.942708 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:43491
--local_ip_for_outbound_sockets=127.28.213.129
--tserver_master_addrs=127.28.213.190:40999
--webserver_port=43137
--webserver_interface=127.28.213.129
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.28.213.129
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:50:47.950855 10470 log.cc:824] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed: Log is configured to *not* fsync() on all Append() calls
I20260808 17:50:47.952369 10470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:50:47.952620 10470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed: Bootstrap complete.
I20260808 17:50:47.954613 10470 raft_consensus.cc:348] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c529b2fffaf04ddca7ee941c74d411ed" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40999 } }
I20260808 17:50:47.954823 10470 raft_consensus.cc:729] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c529b2fffaf04ddca7ee941c74d411ed, State: Initialized, Role: FOLLOWER
I20260808 17:50:47.954968 10470 consensus_queue.cc:260] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c529b2fffaf04ddca7ee941c74d411ed" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40999 } }
I20260808 17:50:47.955027 10470 raft_consensus.cc:388] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:50:47.955067 10470 raft_consensus.cc:482] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:50:47.955111 10470 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [term 1 FOLLOWER]: Advancing to term 2
I20260808 17:50:47.956002 10470 raft_consensus.cc:504] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c529b2fffaf04ddca7ee941c74d411ed" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40999 } }
I20260808 17:50:47.956089 10470 leader_election.cc:302] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c529b2fffaf04ddca7ee941c74d411ed; no voters:
I20260808 17:50:47.956235 10470 leader_election.cc:288] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 17:50:47.956281 10476 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [term 2 FOLLOWER]: Leader election won for term 2
I20260808 17:50:47.956401 10476 raft_consensus.cc:686] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [term 2 LEADER]: Becoming Leader. State: Replica: c529b2fffaf04ddca7ee941c74d411ed, State: Running, Role: LEADER
I20260808 17:50:47.956496 10470 sys_catalog.cc:564] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:50:47.956485 10476 consensus_queue.cc:237] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c529b2fffaf04ddca7ee941c74d411ed" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40999 } }
I20260808 17:50:47.956740 10476 sys_catalog.cc:455] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader c529b2fffaf04ddca7ee941c74d411ed. Latest consensus state: current_term: 2 leader_uuid: "c529b2fffaf04ddca7ee941c74d411ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c529b2fffaf04ddca7ee941c74d411ed" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40999 } } }
I20260808 17:50:47.956810 10476 sys_catalog.cc:458] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:47.956785 10480 sys_catalog.cc:455] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c529b2fffaf04ddca7ee941c74d411ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c529b2fffaf04ddca7ee941c74d411ed" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40999 } } }
I20260808 17:50:47.957176 10480 sys_catalog.cc:458] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed [sys.catalog]: This master's current role is: LEADER
I20260808 17:50:47.957351 10487 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:50:47.957885 10487 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:50:47.958019 10487 catalog_manager.cc:1259] Loaded cluster ID: aa2917659cf94b6191d6d6e27dec25e9
I20260808 17:50:47.958053 10487 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:50:47.959299 10487 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:50:47.959477 10487 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c529b2fffaf04ddca7ee941c74d411ed: Loaded TSK: 0
I20260808 17:50:47.959681 10487 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 17:50:48.023782 10472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:48.023967 10472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:48.023986 10472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:48.025127 10472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:48.025168 10472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:48.025192 10472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:50:48.026648 10472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.129.keytab
--principal=oryx/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:43491
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=43137
--tserver_master_addrs=127.28.213.190:40999
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:48.026842 10472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:48.027045 10472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:48.031500 10512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:48.031502 10511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:48.031714 10515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:48.031983 10472 server_base.cc:1034] running on GCE node
I20260808 17:50:48.032183 10472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:48.032449 10472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:48.033617 10472 hybrid_clock.cc:648] HybridClock initialized: now 1786211448033595 us; error 32 us; skew 500 ppm
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211448, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:48.036526 10472 init.cc:377] Logged in from keytab as oryx/127.28.213.129@KRBTEST.COM (short username oryx)
I20260808 17:50:48.037063 10472 webserver.cc:460] Webserver started at http://127.28.213.129:43137/ using document root <none> and password file <none>
I20260808 17:50:48.037333 10472 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:48.037431 10472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:48.039041 10472 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:50:48.039665 10531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:48.039824 10472 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:50:48.039917 10472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "7fd2faf55a914c6983b789fbebed73bf"
format_stamp: "Formatted at 2026-08-08 17:50:47 on dist-test-slave-bndk"
server_key: "7c6686d552e5268aab7d22cd040073d8"
server_key_iv: "281122b8b1c582a129057eb50f821a6e"
server_key_version: "encryptionkey@0"
I20260808 17:50:48.040289 10472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:48.063681 10472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:48.065683 10472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:48.065812 10472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:48.066020 10472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:48.066334 10472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:48.066372 10472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:48.066401 10472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:48.066434 10472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:48.073098 10472 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:43491
I20260808 17:50:48.073160 10704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:43491 every 8 connection(s)
I20260808 17:50:48.073505 10472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:50:48.078246 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 10472
I20260808 17:50:48.078512 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:44759
--local_ip_for_outbound_sockets=127.28.213.130
--tserver_master_addrs=127.28.213.190:40999
--webserver_port=37513
--webserver_interface=127.28.213.130
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.28.213.130
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:48.082232 10709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:48.074238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.129:34241)
0808 17:50:48.074419 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:48.074460 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:48.074892 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:48.075419 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:48.075423 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:48.076086 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:48.076328 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:48.076334 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.077368 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.077369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:48.078604 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:48.078607 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.079361 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.079362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:48.079499 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:48.080014 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:48.080023 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:48.082046 (+ 2023us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":90,"threads_started":1}
W20260808 17:50:48.082325 10711 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:48.074266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:34241 (local address 127.28.213.190:40999)
0808 17:50:48.075052 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:48.075059 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:48.075085 (+ 26us) server_negotiation.cc:407] Connection header received
0808 17:50:48.075174 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:48.075178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:48.075224 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:48.075314 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:48.076433 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.077280 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.078697 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.079274 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.079364 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:48.082180 (+ 2816us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.129:34241: BlockingRecv error: recv got EOF from 127.28.213.129:34241 (error 108)
Metrics: {"server-negotiator.queue_time_us":739,"thread_start_us":72,"threads_started":1}
W20260808 17:50:48.082561 10705 heartbeater.cc:644] Failed to heartbeat to 127.28.213.190:40999 (0 consecutive failures): Not authorized: Failed to ping master at 127.28.213.190:40999: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:48.086740 10709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:48.082774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.129:34745)
0808 17:50:48.082866 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:48.082876 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:48.082915 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:48.083029 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:48.083030 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:48.083148 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:48.083188 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:48.083190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.083835 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.083835 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:48.084308 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:48.084309 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.084623 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.084624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:48.084685 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:48.085066 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:48.085070 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:48.086685 (+ 1615us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":76}
W20260808 17:50:48.086820 10711 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:48.082865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:34745 (local address 127.28.213.190:40999)
0808 17:50:48.082897 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:48.082899 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:48.082914 (+ 15us) server_negotiation.cc:407] Connection header received
0808 17:50:48.082960 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:48.082961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:48.082973 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:48.083020 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:48.083277 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.083743 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.084380 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.084566 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.084619 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:48.086770 (+ 2151us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.129:34745: BlockingRecv error: recv got EOF from 127.28.213.129:34745 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:48.091106 10709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:48.087071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.129:48379)
0808 17:50:48.087119 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:48.087130 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:48.087175 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:48.087300 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:48.087301 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:48.087435 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:48.087466 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:48.087468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.088058 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.088059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:48.088780 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:48.088783 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.089086 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.089087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:48.089139 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:48.089480 (+ 341us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:48.089485 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:48.091046 (+ 1561us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 17:50:48.091146 10711 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:48.087123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:48379 (local address 127.28.213.190:40999)
0808 17:50:48.087155 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:48.087157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:48.087165 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:48.087231 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:48.087231 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:48.087239 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:48.087278 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:48.087530 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.087972 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.088862 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.089028 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.089068 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:48.091110 (+ 2042us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.129:48379: BlockingRecv error: recv got EOF from 127.28.213.129:48379 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260808 17:50:48.091342 10705 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 17:50:48.161439 10712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:48.161619 10712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:48.161639 10712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:48.162745 10712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:48.162783 10712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:48.162812 10712 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:50:48.164187 10712 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.130.keytab
--principal=oryx/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:44759
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=37513
--tserver_master_addrs=127.28.213.190:40999
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:48.164403 10712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:48.164601 10712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:48.169061 10719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:48.169061 10724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:48.169195 10712 server_base.cc:1034] running on GCE node
W20260808 17:50:48.169057 10721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:48.169520 10712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:48.169730 10712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:48.170862 10712 hybrid_clock.cc:648] HybridClock initialized: now 1786211448170851 us; error 23 us; skew 500 ppm
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211448, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:48.173208 10712 init.cc:377] Logged in from keytab as oryx/127.28.213.130@KRBTEST.COM (short username oryx)
I20260808 17:50:48.173612 10712 webserver.cc:460] Webserver started at http://127.28.213.130:37513/ using document root <none> and password file <none>
I20260808 17:50:48.173794 10712 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:48.173842 10712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:48.175060 10712 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:50:48.175549 10733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:48.175688 10712 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:48.175766 10712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "8ca2f01989a2412eb87f87be8dc72959"
format_stamp: "Formatted at 2026-08-08 17:50:47 on dist-test-slave-bndk"
server_key: "8f2a6296bd300503639e9b8f0f4d4572"
server_key_iv: "fa11dfa2dac0ebee148bef2160c91dac"
server_key_version: "encryptionkey@0"
I20260808 17:50:48.176055 10712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:48.186746 10712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:48.188515 10712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:48.188618 10712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:48.188763 10712 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:48.188980 10712 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:48.189009 10712 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:48.189028 10712 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:48.189045 10712 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:48.194466 10712 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:44759
I20260808 17:50:48.194514 10900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:44759 every 8 connection(s)
I20260808 17:50:48.194805 10712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 17:50:48.201161 10711 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:48.195396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:40305 (local address 127.28.213.190:40999)
0808 17:50:48.195439 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:48.195441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:48.195624 (+ 183us) server_negotiation.cc:407] Connection header received
0808 17:50:48.196082 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:48.196083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:48.196100 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:48.196149 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:48.197000 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.197516 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.198460 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.198640 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.198696 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:48.201107 (+ 2411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.130:40305: BlockingRecv error: recv got EOF from 127.28.213.130:40305 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:50:48.201187 10904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:48.195378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.130:40305)
0808 17:50:48.195521 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:48.195553 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:48.195990 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:48.196212 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:48.196216 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:48.196724 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:48.196893 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:48.196898 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.197603 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.197604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:48.198374 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:48.198376 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.198709 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.198710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:48.198824 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:48.199201 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:48.199208 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:48.201014 (+ 1806us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":68,"threads_started":1}
W20260808 17:50:48.201416 10901 heartbeater.cc:644] Failed to heartbeat to 127.28.213.190:40999 (0 consecutive failures): Not authorized: Failed to ping master at 127.28.213.190:40999: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:48.204615 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 10712
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:48.204890 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:41447
--local_ip_for_outbound_sockets=127.28.213.131
--tserver_master_addrs=127.28.213.190:40999
--webserver_port=33399
--webserver_interface=127.28.213.131
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.28.213.131
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:50:48.205272 10904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:48.201602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.130:60761)
0808 17:50:48.201690 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:48.201700 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:48.201748 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:48.201860 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:48.201860 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:48.201979 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:48.202018 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:48.202019 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.202593 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.202594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:48.203081 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:48.203082 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.203382 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.203382 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:48.203443 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:48.203731 (+ 288us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:48.203734 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:48.205188 (+ 1454us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":74}
W20260808 17:50:48.205333 10711 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:48.201652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:60761 (local address 127.28.213.190:40999)
0808 17:50:48.201694 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:48.201697 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:48.201734 (+ 37us) server_negotiation.cc:407] Connection header received
0808 17:50:48.201792 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:48.201793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:48.201801 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:48.201842 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:48.202079 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.202528 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.203148 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.203326 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.203376 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:48.205290 (+ 1914us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.130:60761: BlockingRecv error: recv got EOF from 127.28.213.130:60761 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:48.209146 10904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:48.205542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.130:35285)
0808 17:50:48.205579 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:48.205590 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:48.205631 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:48.205731 (+ 100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:48.205732 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:48.205854 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:48.205883 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:48.205884 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.206435 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.206436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:48.206894 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:48.206896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.207186 (+ 290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.207187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:48.207235 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:48.207589 (+ 354us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:48.207593 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:48.209108 (+ 1515us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":19}
W20260808 17:50:48.209259 10901 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 17:50:48.209275 10711 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:48.205601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:35285 (local address 127.28.213.190:40999)
0808 17:50:48.205631 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:48.205633 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:48.205641 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:48.205679 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:48.205679 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:48.205686 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:48.205727 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:48.205949 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.206362 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.206965 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.207132 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.207181 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:48.209204 (+ 2023us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.130:35285: BlockingRecv error: recv got EOF from 127.28.213.130:35285 (error 108)
Metrics: {"server-negotiator.queue_time_us":13}
W20260808 17:50:48.284238 10905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:50:48.284428 10905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:50:48.284451 10905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:50:48.285573 10905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:50:48.285611 10905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:50:48.285637 10905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:50:48.287001 10905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/krb5kdc/oryx_127.28.213.131.keytab
--principal=oryx/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:41447
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=33399
--tserver_master_addrs=127.28.213.190:40999
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:50:48.287201 10905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:50:48.287395 10905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:50:48.291949 10916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:50:48.292083 10914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:48.292066 10905 server_base.cc:1034] running on GCE node
W20260808 17:50:48.291953 10912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:50:48.292372 10905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:50:48.292591 10905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:50:48.293722 10905 hybrid_clock.cc:648] HybridClock initialized: now 1786211448293709 us; error 29 us; skew 500 ppm
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211448, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:50:48.295995 10905 init.cc:377] Logged in from keytab as oryx/127.28.213.131@KRBTEST.COM (short username oryx)
I20260808 17:50:48.296371 10905 webserver.cc:460] Webserver started at http://127.28.213.131:33399/ using document root <none> and password file <none>
I20260808 17:50:48.296559 10905 fs_manager.cc:359] Metadata directory not provided
I20260808 17:50:48.296622 10905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:50:48.297902 10905 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260808 17:50:48.298406 10924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:48.298552 10905 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:50:48.298631 10905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "e82a1911958848fc9ea2cf524a8e0116"
format_stamp: "Formatted at 2026-08-08 17:50:47 on dist-test-slave-bndk"
server_key: "5ac22f875f4b67c9b0a759e274954dca"
server_key_iv: "57c7240c15f5ea17b1eb487ae2011b18"
server_key_version: "encryptionkey@0"
I20260808 17:50:48.298933 10905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:50:48.317974 10905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:50:48.320030 10905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:50:48.320199 10905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:50:48.320422 10905 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:50:48.320710 10905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:50:48.320744 10905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:48.320772 10905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:50:48.320789 10905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:50:48.326509 10905 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:41447
I20260808 17:50:48.326570 11090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:41447 every 8 connection(s)
I20260808 17:50:48.326870 10905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:50:48.330214 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 10905
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 17:50:48.333775 10711 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:48.327489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:52219 (local address 127.28.213.190:40999)
0808 17:50:48.327568 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:48.327570 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:48.327739 (+ 169us) server_negotiation.cc:407] Connection header received
0808 17:50:48.328186 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:48.328187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:48.328197 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:48.328246 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:48.329091 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.329622 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.330717 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.330927 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.330989 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:48.333720 (+ 2731us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.131:52219: BlockingRecv error: recv got EOF from 127.28.213.131:52219 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 17:50:48.333837 11093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:48.327478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.131:52219)
0808 17:50:48.327626 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:48.327661 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:48.328113 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:48.328301 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:48.328304 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:48.328835 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:48.329022 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:48.329027 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.329690 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.329691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:48.330606 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:48.330610 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.331012 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.331014 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:48.331143 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:48.331554 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:48.331562 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:48.333648 (+ 2086us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":83,"threads_started":1}
W20260808 17:50:48.334026 11091 heartbeater.cc:644] Failed to heartbeat to 127.28.213.190:40999 (0 consecutive failures): Not authorized: Failed to ping master at 127.28.213.190:40999: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:48.337350 11097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:48.330678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56798 (local address 127.28.213.190:40999)
0808 17:50:48.330782 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:48.330784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:48.330791 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:50:48.330860 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:48.330861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:48.330872 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:48.330930 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:48.331508 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.331965 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.332835 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.333052 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.333106 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:48.334365 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:50:48.334369 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:50:48.334369 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:50:48.334381 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:50:48.335874 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:48.336188 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:48.336191 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:48.336192 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:48.336290 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:50:48.336679 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:50:48.336679 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:50:48.336679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:50:48.336867 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:50:48.336988 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 17:50:48.337126 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 17:50:48.337261 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":58,"threads_started":1}
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:48.338300 11093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:48.334245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.131:43593)
0808 17:50:48.334286 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:48.334294 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:48.334324 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:48.334448 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:48.334449 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:48.334549 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:48.334586 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:48.334587 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.335346 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.335347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:48.335818 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:48.335819 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.336178 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.336179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:48.336234 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:48.336555 (+ 321us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:48.336560 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:48.338245 (+ 1685us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 17:50:48.338352 10711 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:48.334282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:43593 (local address 127.28.213.190:40999)
0808 17:50:48.334314 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:48.334316 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:48.334322 (+ 6us) server_negotiation.cc:407] Connection header received
0808 17:50:48.334367 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:48.334367 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:48.334375 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:48.334444 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:48.334647 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.335278 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.335889 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.336113 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.336161 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:48.338310 (+ 2149us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.131:43593: BlockingRecv error: recv got EOF from 127.28.213.131:43593 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:48 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:48.341920 11093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:48.338554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.131:50513)
0808 17:50:48.338585 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:48.338594 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:48.338631 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:48.338728 (+ 97us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:48.338728 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:48.338843 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:48.338865 (+ 22us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:48.338866 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.339419 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.339420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:48.339877 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:48.339878 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.340184 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.340184 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:48.340232 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:48.340551 (+ 319us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:48.340556 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:48.341865 (+ 1309us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":17}
W20260808 17:50:48.342001 10711 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:48.338591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:50513 (local address 127.28.213.190:40999)
0808 17:50:48.338629 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:48.338631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:48.338639 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:48.338676 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:48.338676 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:48.338685 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:48.338726 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:48.338933 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.339350 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.339947 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:48.340130 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:48.340178 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:48.341956 (+ 1778us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.131:50513: BlockingRecv error: recv got EOF from 127.28.213.131:50513 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 17:50:48.342038 11091 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 17:50:49 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:49 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:49.098580 11098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:49.091636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.129:54695)
0808 17:50:49.091755 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:49.091766 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:49.091815 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:49.091935 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:49.091936 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:49.092088 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:49.092135 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:49.092136 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:49.092711 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:49.092711 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:49.093290 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:49.093293 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:49.093569 (+ 276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:49.093570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:49.093605 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:49.096840 (+ 3235us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:49.096845 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:49.098514 (+ 1669us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":60,"threads_started":1}
W20260808 17:50:49.098673 11099 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:49.091698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:54695 (local address 127.28.213.190:40999)
0808 17:50:49.091808 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:49.091809 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:49.091818 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:50:49.091857 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:49.091858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:49.091867 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:49.091927 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:49.092182 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:49.092660 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:49.093343 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:49.093523 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:49.093567 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:49.098600 (+ 5033us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.129:54695: BlockingRecv error: recv got EOF from 127.28.213.129:54695 (error 108)
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":53,"threads_started":1}
Aug 08 17:50:49 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:49 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:49.213878 11100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:49.209600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.130:45317)
0808 17:50:49.209739 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:49.209750 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:49.209815 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:49.209945 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:49.209946 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:49.210114 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:49.210160 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:49.210162 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:49.210793 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:49.210794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:49.211353 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:49.211355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:49.211684 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:49.211686 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:49.211739 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:49.212143 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:49.212148 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:49.213796 (+ 1648us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":74,"threads_started":1}
W20260808 17:50:49.213945 11099 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:49.209671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:45317 (local address 127.28.213.190:40999)
0808 17:50:49.209736 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:49.209738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:49.209808 (+ 70us) server_negotiation.cc:407] Connection header received
0808 17:50:49.209865 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:49.209865 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:49.209878 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:49.209926 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:49.210231 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:49.210722 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:49.211437 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:49.211625 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:49.211679 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:49.213893 (+ 2214us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.130:45317: BlockingRecv error: recv got EOF from 127.28.213.130:45317 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 08 17:50:49 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:49 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:49.346681 11101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:49.342358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.131:59611)
0808 17:50:49.342495 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:49.342506 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:49.342569 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:49.342692 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:49.342693 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:49.342860 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:49.342904 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:49.342915 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:49.343560 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:49.343561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:49.344110 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:49.344111 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:49.344487 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:49.344488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:49.344542 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:49.344951 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:49.344957 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:49.346601 (+ 1644us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":80,"threads_started":1}
W20260808 17:50:49.346748 11099 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:49.342421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:59611 (local address 127.28.213.190:40999)
0808 17:50:49.342478 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:49.342480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:49.342558 (+ 78us) server_negotiation.cc:407] Connection header received
0808 17:50:49.342618 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:49.342619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:49.342632 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:49.342672 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:49.342979 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:49.343495 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:49.344187 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:49.344399 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:49.344458 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:49.346695 (+ 2237us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.131:59611: BlockingRecv error: recv got EOF from 127.28.213.131:59611 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 08 17:50:50 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:50 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:50.103219 11102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:50.098976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.129:43887)
0808 17:50:50.099091 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:50.099100 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:50.099147 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:50.099262 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:50.099262 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:50.099445 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:50.099493 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:50.099494 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:50.100088 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:50.100089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:50.100631 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:50.100632 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:50.100937 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:50.100938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:50.100983 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:50.101423 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:50.101428 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:50.103143 (+ 1715us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":57,"threads_started":1}
W20260808 17:50:50.103300 11104 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:50.099037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:43887 (local address 127.28.213.190:40999)
0808 17:50:50.099155 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:50.099157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:50.099164 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:50:50.099186 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:50.099186 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:50.099196 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:50.099253 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:50.099547 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:50.100037 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:50.100690 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:50.100880 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:50.100933 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:50.103240 (+ 2307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.129:43887: BlockingRecv error: recv got EOF from 127.28.213.129:43887 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":62,"threads_started":1}
Aug 08 17:50:50 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:50 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:50.218339 11106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:50.214323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.130:57405)
0808 17:50:50.214452 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:50.214463 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:50.214526 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:50.214637 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:50.214638 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:50.214801 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:50.214849 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:50.214851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:50.215446 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:50.215446 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:50.215988 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:50.215989 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:50.216264 (+ 275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:50.216265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:50.216300 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:50.216686 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:50.216690 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:50.218281 (+ 1591us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":63,"threads_started":1}
W20260808 17:50:50.218436 11104 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:50.214393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:57405 (local address 127.28.213.190:40999)
0808 17:50:50.214462 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:50.214464 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:50.214519 (+ 55us) server_negotiation.cc:407] Connection header received
0808 17:50:50.214568 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:50.214568 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:50.214579 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:50.214625 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:50.214902 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:50.215390 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:50.216045 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:50.216219 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:50.216261 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:50.218373 (+ 2112us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.130:57405: BlockingRecv error: recv got EOF from 127.28.213.130:57405 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 17:50:50 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:50 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:50.351222 11107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:50.347108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.131:37267)
0808 17:50:50.347241 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:50.347253 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:50.347311 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:50.347433 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:50.347433 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:50.347589 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:50.347637 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:50.347639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:50.348232 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:50.348233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:50.348763 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:50.348764 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:50.349076 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:50.349076 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:50.349113 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:50.349527 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:50.349532 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:50.351163 (+ 1631us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":69,"threads_started":1}
W20260808 17:50:50.351326 11104 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:50.347188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:37267 (local address 127.28.213.190:40999)
0808 17:50:50.347235 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:50.347238 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:50.347305 (+ 67us) server_negotiation.cc:407] Connection header received
0808 17:50:50.347352 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:50.347353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:50.347365 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:50.347421 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:50.347686 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:50.348175 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:50.348830 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:50.349025 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:50.349075 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:50.351253 (+ 2178us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.131:37267: BlockingRecv error: recv got EOF from 127.28.213.131:37267 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 08 17:50:51 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:51 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:51.107748 11108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:51.103641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.129:42431)
0808 17:50:51.103764 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:51.103773 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:51.103820 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:51.103945 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:51.103946 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:51.104104 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:51.104155 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:51.104157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:51.104753 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:51.104754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:51.105321 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:51.105324 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:51.105659 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:51.105660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:51.105697 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:51.106096 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:51.106100 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:51.107690 (+ 1590us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":66,"threads_started":1}
W20260808 17:50:51.107863 11112 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:51.103714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:42431 (local address 127.28.213.190:40999)
0808 17:50:51.103834 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:51.103836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:51.103844 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:51.103865 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:51.103865 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:51.103875 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:51.103935 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:51.104206 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:51.104704 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:51.105395 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:51.105607 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:51.105659 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:51.107786 (+ 2127us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.129:42431: BlockingRecv error: recv got EOF from 127.28.213.129:42431 (error 108)
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":57,"threads_started":1}
Aug 08 17:50:51 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:51 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:51.222970 11113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:51.218796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.130:39345)
0808 17:50:51.218925 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:51.218935 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:51.218990 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:51.219110 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:51.219111 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:51.219294 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:51.219345 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:51.219347 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:51.219925 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:51.219926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:51.220448 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:51.220449 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:51.220765 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:51.220765 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:51.220801 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:51.221186 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:51.221190 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:51.222893 (+ 1703us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":67,"threads_started":1}
W20260808 17:50:51.223054 11112 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:51.218870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:39345 (local address 127.28.213.190:40999)
0808 17:50:51.218944 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:51.218945 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:51.218977 (+ 32us) server_negotiation.cc:407] Connection header received
0808 17:50:51.219046 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:51.219046 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:51.219057 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:51.219096 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:51.219395 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:51.219870 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:51.220518 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:51.220709 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:51.220760 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:51.223002 (+ 2242us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.130:39345: BlockingRecv error: recv got EOF from 127.28.213.130:39345 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 08 17:50:51 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:51 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:51.356094 11114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:51.351660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.131:52221)
0808 17:50:51.351809 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:51.351821 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:51.351891 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:51.352031 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:51.352032 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:51.352213 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:51.352259 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:51.352261 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:51.352887 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:51.352888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:51.353536 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:51.353539 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:51.353863 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:51.353864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:51.353926 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:51.354331 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:51.354335 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:51.356034 (+ 1699us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":74,"threads_started":1}
W20260808 17:50:51.356177 11112 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:51.351727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:52221 (local address 127.28.213.190:40999)
0808 17:50:51.351793 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:51.351795 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:51.351879 (+ 84us) server_negotiation.cc:407] Connection header received
0808 17:50:51.351960 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:51.351961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:51.351974 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:51.352015 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:51.352330 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:51.352815 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:51.353618 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:51.353805 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:51.353857 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:51.356116 (+ 2259us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.131:52221: BlockingRecv error: recv got EOF from 127.28.213.131:52221 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 17:50:52 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:52 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:52.112316 11115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:52.108164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.129:44365)
0808 17:50:52.108307 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:52.108320 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:52.108380 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:52.108505 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:52.108506 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:52.108668 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:52.108719 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:52.108720 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:52.109331 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:52.109331 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:52.109856 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:52.109857 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:52.110138 (+ 281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:52.110139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:52.110179 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:52.110605 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:52.110609 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:52.112259 (+ 1650us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":65,"threads_started":1}
W20260808 17:50:52.112414 11116 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:52.108234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:44365 (local address 127.28.213.190:40999)
0808 17:50:52.108366 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:52.108368 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:52.108376 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:52.108430 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:52.108430 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:52.108440 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:52.108496 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:52.108768 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:52.109283 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:52.109915 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:52.110090 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:52.110130 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:52.112347 (+ 2217us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.129:44365: BlockingRecv error: recv got EOF from 127.28.213.129:44365 (error 108)
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
Aug 08 17:50:52 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:52 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:52.227727 11121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:52.223389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.130:40721)
0808 17:50:52.223552 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:52.223562 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:52.223623 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:52.223756 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:52.223757 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:52.223933 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:52.223979 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:52.223981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:52.224627 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:52.224629 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:52.225177 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:52.225179 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:52.225573 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:52.225574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:52.225654 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:52.226044 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:52.226048 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:52.227650 (+ 1602us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":92,"threads_started":1}
W20260808 17:50:52.227802 11116 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:52.223462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:40721 (local address 127.28.213.190:40999)
0808 17:50:52.223520 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:52.223523 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:52.223612 (+ 89us) server_negotiation.cc:407] Connection header received
0808 17:50:52.223681 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:52.223681 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:52.223694 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:52.223745 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:52.224047 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:52.224557 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:52.225300 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:52.225511 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:52.225567 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:52.227749 (+ 2182us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.130:40721: BlockingRecv error: recv got EOF from 127.28.213.130:40721 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 08 17:50:52 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:52 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:52.360991 11122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:52.356506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.131:54341)
0808 17:50:52.356647 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:52.356659 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:52.356728 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:52.356851 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:52.356852 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:52.357042 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:52.357090 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:52.357092 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:52.357830 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:52.357831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:52.358360 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:52.358363 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:52.358688 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:52.358690 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:52.358744 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:52.359145 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:52.359149 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:52.360914 (+ 1765us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":68,"threads_started":1}
W20260808 17:50:52.361052 11116 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:52.356560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:54341 (local address 127.28.213.190:40999)
0808 17:50:52.356629 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:52.356631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:52.356718 (+ 87us) server_negotiation.cc:407] Connection header received
0808 17:50:52.356778 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:52.356779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:52.356792 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:52.356839 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:52.357161 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:52.357754 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:52.358442 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:52.358628 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:52.358683 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:52.360999 (+ 2316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.131:54341: BlockingRecv error: recv got EOF from 127.28.213.131:54341 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 08 17:50:53 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:53 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:53.116890 11123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:53.112742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.129:46755)
0808 17:50:53.112861 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:53.112871 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:53.112934 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:53.113060 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:53.113061 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:53.113252 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:53.113306 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:53.113308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:53.113914 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:53.113915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:53.114434 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:53.114436 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:53.114760 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:53.114760 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:53.114796 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:53.115195 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:53.115199 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:53.116832 (+ 1633us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":67,"threads_started":1}
W20260808 17:50:53.116993 11125 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:53.112804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:46755 (local address 127.28.213.190:40999)
0808 17:50:53.112940 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:53.112942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:53.112951 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:50:53.112976 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:53.112977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:53.112989 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:53.113049 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:53.113357 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:53.113849 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:53.114487 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:53.114709 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:53.114757 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:53.116926 (+ 2169us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.129:46755: BlockingRecv error: recv got EOF from 127.28.213.129:46755 (error 108)
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":77,"threads_started":1}
Aug 08 17:50:53 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:53 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:53.232450 11126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:53.228257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.130:55147)
0808 17:50:53.228438 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:53.228449 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:53.228508 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:53.228623 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:53.228624 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:53.228788 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:53.228836 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:53.228838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:53.229474 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:53.229474 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:53.229994 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:53.229995 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:53.230276 (+ 281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:53.230276 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:53.230311 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:53.230735 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:53.230739 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:53.232384 (+ 1645us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":102,"threads_started":1}
W20260808 17:50:53.232550 11125 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:53.228376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:55147 (local address 127.28.213.190:40999)
0808 17:50:53.228441 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:53.228442 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:53.228493 (+ 51us) server_negotiation.cc:407] Connection header received
0808 17:50:53.228561 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:53.228562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:53.228573 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:53.228610 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:53.228891 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:53.229423 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:53.230052 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:53.230232 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:53.230272 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:53.232485 (+ 2213us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.130:55147: BlockingRecv error: recv got EOF from 127.28.213.130:55147 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 08 17:50:53 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:53 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:53.365775 11127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:53.361435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.131:56967)
0808 17:50:53.361599 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:53.361608 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:53.361671 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:53.361814 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:53.361815 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:53.361991 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:53.362041 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:53.362043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:53.362622 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:53.362622 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:53.363148 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:53.363149 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:53.363557 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:53.363558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:53.363599 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:53.364013 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:53.364017 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:53.365712 (+ 1695us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":87,"threads_started":1}
W20260808 17:50:53.365864 11125 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:53.361503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:56967 (local address 127.28.213.190:40999)
0808 17:50:53.361564 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:53.361566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:53.361670 (+ 104us) server_negotiation.cc:407] Connection header received
0808 17:50:53.361734 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:53.361735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:53.361750 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:53.361801 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:53.362095 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:53.362570 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:53.363204 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:53.363476 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:53.363542 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:53.365798 (+ 2256us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.131:56967: BlockingRecv error: recv got EOF from 127.28.213.131:56967 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 08 17:50:54 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:54 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:54.124658 11128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:54.117356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.129:33233)
0808 17:50:54.117482 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:54.117492 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:54.117541 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:54.117715 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:54.117716 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:54.117875 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:54.117924 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:54.117925 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:54.118573 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:54.118574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:54.119096 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:54.119097 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:54.119429 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:54.119429 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:54.119467 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:54.122860 (+ 3393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:54.122865 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:54.124600 (+ 1735us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":67,"threads_started":1}
W20260808 17:50:54.124799 11131 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:54.117436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:33233 (local address 127.28.213.190:40999)
0808 17:50:54.117592 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:54.117594 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:54.117604 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:50:54.117626 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:54.117626 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:54.117637 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:54.117700 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:54.118004 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:54.118516 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:54.119166 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:54.119361 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:54.119427 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:54.124712 (+ 5285us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.129:33233: BlockingRecv error: recv got EOF from 127.28.213.129:33233 (error 108)
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":78,"threads_started":1}
Aug 08 17:50:54 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:54 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:54.237912 11132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:54.232877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.130:50985)
0808 17:50:54.232979 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:54.232989 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:54.233053 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:54.233173 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:54.233174 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:54.233403 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:54.233467 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:54.233471 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:54.234223 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:54.234224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:54.234997 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:54.235002 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:54.235442 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:54.235444 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:54.235504 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:54.235926 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:54.235932 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:54.237833 (+ 1901us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":54,"threads_started":1}
W20260808 17:50:54.237991 11131 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:54.232951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:50985 (local address 127.28.213.190:40999)
0808 17:50:54.233001 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:54.233003 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:54.233050 (+ 47us) server_negotiation.cc:407] Connection header received
0808 17:50:54.233108 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:54.233109 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:54.233122 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:54.233167 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:54.233537 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:54.234147 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:54.235080 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:54.235369 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:54.235438 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:54.237938 (+ 2500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.130:50985: BlockingRecv error: recv got EOF from 127.28.213.130:50985 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 08 17:50:54 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:54 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:54.370450 11133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:54.366223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.131:58673)
0808 17:50:54.366371 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:54.366381 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:54.366439 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:54.366550 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:54.366550 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:54.366718 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:54.366766 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:54.366768 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:54.367360 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:54.367361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:54.367884 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:54.367886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:54.368233 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:54.368233 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:54.368269 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:54.368707 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:54.368712 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:54.370390 (+ 1678us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":85,"threads_started":1}
W20260808 17:50:54.370540 11131 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:54.366273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:58673 (local address 127.28.213.190:40999)
0808 17:50:54.366338 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:54.366340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:54.366425 (+ 85us) server_negotiation.cc:407] Connection header received
0808 17:50:54.366488 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:54.366489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:54.366502 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:54.366538 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:54.366816 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:54.367303 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:54.367977 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:54.368173 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:54.368235 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:54.370476 (+ 2241us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.131:58673: BlockingRecv error: recv got EOF from 127.28.213.131:58673 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 08 17:50:55 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:55 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:55.129551 11134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:55.125069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.129:52315)
0808 17:50:55.125231 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:55.125245 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:55.125301 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:55.125435 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:55.125436 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:55.125596 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:55.125675 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:55.125677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:55.126290 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:55.126291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:55.126900 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:55.126903 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:55.127319 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:55.127320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:55.127368 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:55.127751 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:55.127755 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:55.129475 (+ 1720us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":67,"threads_started":1}
W20260808 17:50:55.129633 11136 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:55.125152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:52315 (local address 127.28.213.190:40999)
0808 17:50:55.125271 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:55.125273 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:55.125288 (+ 15us) server_negotiation.cc:407] Connection header received
0808 17:50:55.125354 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:55.125355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:55.125366 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:55.125419 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:55.125741 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:55.126231 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:55.126967 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:55.127259 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:55.127309 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:55.129573 (+ 2264us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.129:52315: BlockingRecv error: recv got EOF from 127.28.213.129:52315 (error 108)
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":52,"threads_started":1}
Aug 08 17:50:55 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:55 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:55.242676 11137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:55.238383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.130:36993)
0808 17:50:55.238538 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:55.238549 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:55.238612 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:55.238742 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:55.238743 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:55.238918 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:55.238965 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:55.238967 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:55.239592 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:55.239594 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:55.240119 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:55.240121 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:55.240453 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:55.240454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:55.240510 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:55.240904 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:55.240908 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:55.242598 (+ 1690us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":86,"threads_started":1}
W20260808 17:50:55.242753 11136 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:55.238441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:36993 (local address 127.28.213.190:40999)
0808 17:50:55.238516 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:55.238518 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:55.238603 (+ 85us) server_negotiation.cc:407] Connection header received
0808 17:50:55.238665 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:55.238666 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:55.238679 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:55.238730 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:55.239036 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:55.239523 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:55.240194 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:55.240387 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:55.240442 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:55.242699 (+ 2257us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.130:36993: BlockingRecv error: recv got EOF from 127.28.213.130:36993 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 08 17:50:55 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:55 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:55.375311 11138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:55.370893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.131:40269)
0808 17:50:55.371063 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:55.371073 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:55.371139 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:55.371261 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:55.371262 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:55.371455 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:55.371502 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:55.371504 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:55.372136 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:55.372137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:55.372711 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:55.372714 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:55.373044 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:55.373045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:55.373103 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:55.373544 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:55.373549 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:55.375251 (+ 1702us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":91,"threads_started":1}
W20260808 17:50:55.375404 11136 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:55.370963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:40269 (local address 127.28.213.190:40999)
0808 17:50:55.371020 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:55.371023 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:55.371129 (+ 106us) server_negotiation.cc:407] Connection header received
0808 17:50:55.371191 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:55.371192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:55.371206 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:55.371255 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:55.371574 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:55.372064 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:55.372789 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:55.372983 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:55.373038 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:55.375338 (+ 2300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.131:40269: BlockingRecv error: recv got EOF from 127.28.213.131:40269 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 08 17:50:56 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:56 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:56.134441 11139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:56.129987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.129:37119)
0808 17:50:56.130123 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:56.130136 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:56.130203 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:56.130337 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:56.130338 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:56.130509 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:56.130560 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:56.130561 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:56.131251 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:56.131253 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:56.131896 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:56.131899 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:56.132213 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:56.132214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:56.132251 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:56.132650 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:56.132655 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:56.134365 (+ 1710us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":72,"threads_started":1}
W20260808 17:50:56.134521 11141 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:56.130102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:37119 (local address 127.28.213.190:40999)
0808 17:50:56.130224 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:56.130226 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:56.130249 (+ 23us) server_negotiation.cc:407] Connection header received
0808 17:50:56.130268 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:56.130269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:56.130279 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:56.130326 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:56.130610 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:56.131176 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:56.131965 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:56.132158 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:56.132208 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:56.134454 (+ 2246us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.129:37119: BlockingRecv error: recv got EOF from 127.28.213.129:37119 (error 108)
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":67,"threads_started":1}
Aug 08 17:50:56 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:56 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:56.247879 11142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:56.243236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.130:36511)
0808 17:50:56.243366 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:56.243377 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:56.243445 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:56.243565 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:56.243566 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:56.243741 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:56.243785 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:56.243787 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:56.244581 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:56.244582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:56.245109 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:56.245111 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:56.245502 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:56.245503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:56.245561 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:56.245959 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:56.245963 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:56.247782 (+ 1819us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":68,"threads_started":1}
W20260808 17:50:56.247931 11141 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:56.243301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:36511 (local address 127.28.213.190:40999)
0808 17:50:56.243360 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:56.243362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:56.243433 (+ 71us) server_negotiation.cc:407] Connection header received
0808 17:50:56.243493 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:56.243494 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:56.243507 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:56.243553 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:56.243852 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:56.244509 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:56.245180 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:56.245437 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:56.245494 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:56.247879 (+ 2385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.130:36511: BlockingRecv error: recv got EOF from 127.28.213.130:36511 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 08 17:50:56 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:56 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:56.380167 11143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:56.375726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.131:54421)
0808 17:50:56.375863 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:56.375874 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:56.375955 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:56.376088 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:56.376089 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:56.376264 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:56.376314 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:56.376316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:56.376950 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:56.376951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:56.377526 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:56.377529 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:56.377861 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:56.377862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:56.377924 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:56.378369 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:56.378373 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:56.380090 (+ 1717us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":71,"threads_started":1}
W20260808 17:50:56.380260 11141 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:56.375792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:54421 (local address 127.28.213.190:40999)
0808 17:50:56.375854 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:56.375857 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:56.375946 (+ 89us) server_negotiation.cc:407] Connection header received
0808 17:50:56.376019 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:56.376020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:56.376032 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:56.376075 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:56.376385 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:56.376876 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:56.377596 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:56.377782 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:56.377835 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:56.380199 (+ 2364us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.131:54421: BlockingRecv error: recv got EOF from 127.28.213.131:54421 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 08 17:50:57 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:57 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:57.139663 11146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:57.134887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.129:60805)
0808 17:50:57.135043 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:57.135053 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:57.135112 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:57.135232 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:57.135232 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:57.135399 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:57.135448 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:57.135450 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:57.136078 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:57.136078 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:57.136759 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:57.136762 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:57.137112 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:57.137113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:57.137156 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:57.137607 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:57.137612 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:57.139605 (+ 1993us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":88,"threads_started":1}
W20260808 17:50:57.139771 11147 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:57.134946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:60805 (local address 127.28.213.190:40999)
0808 17:50:57.135052 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:57.135054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:57.135110 (+ 56us) server_negotiation.cc:407] Connection header received
0808 17:50:57.135162 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:57.135163 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:57.135174 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:57.135221 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:57.135499 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:57.136021 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:57.136836 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:57.137053 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:57.137104 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:57.139695 (+ 2591us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.129:60805: BlockingRecv error: recv got EOF from 127.28.213.129:60805 (error 108)
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":48,"threads_started":1}
Aug 08 17:50:57 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:57 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:57.252712 11148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:57.248293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.130:37057)
0808 17:50:57.248409 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:57.248421 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:57.248486 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:57.248616 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:57.248618 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:57.248785 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:57.248831 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:57.248833 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:57.249495 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:57.249496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:57.250020 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:57.250023 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:57.250340 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:57.250341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:57.250397 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:57.250810 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:57.250814 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:57.252628 (+ 1814us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":63,"threads_started":1}
W20260808 17:50:57.252791 11147 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:57.248379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:37057 (local address 127.28.213.190:40999)
0808 17:50:57.248471 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:57.248473 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:57.248482 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:50:57.248549 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:57.248550 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:57.248561 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:57.248603 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:57.248902 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:57.249427 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:57.250094 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:57.250282 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:57.250335 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:57.252728 (+ 2393us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.130:37057: BlockingRecv error: recv got EOF from 127.28.213.130:37057 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 08 17:50:57 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:57 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:57.384980 11149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:57.380637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.131:45635)
0808 17:50:57.380756 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:57.380765 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:57.380827 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:57.380940 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:57.380940 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:57.381109 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:57.381154 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:57.381156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:57.381779 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:57.381780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:57.382322 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:57.382324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:57.382618 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:57.382619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:57.382665 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:57.383076 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:57.383081 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:57.384904 (+ 1823us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":64,"threads_started":1}
W20260808 17:50:57.385047 11147 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:57.380701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:45635 (local address 127.28.213.190:40999)
0808 17:50:57.380757 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:57.380758 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:57.380818 (+ 60us) server_negotiation.cc:407] Connection header received
0808 17:50:57.380868 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:57.380869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:57.380881 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:57.380929 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:57.381201 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:57.381709 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:57.382378 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:57.382556 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:57.382597 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:57.384996 (+ 2399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.131:45635: BlockingRecv error: recv got EOF from 127.28.213.131:45635 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 08 17:50:58 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:58 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:58.144388 11151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:58.140067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.129:35673)
0808 17:50:58.140197 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:58.140207 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:58.140253 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:58.140378 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:58.140379 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:58.140546 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:58.140595 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:58.140597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:58.141187 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:58.141187 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:58.141815 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:58.141818 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:58.142138 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:58.142139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:58.142176 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:58.142611 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:58.142616 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:58.144296 (+ 1680us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":58,"threads_started":1}
W20260808 17:50:58.144455 11153 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:58.140125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:35673 (local address 127.28.213.190:40999)
0808 17:50:58.140245 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:58.140247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:58.140255 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:50:58.140295 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:58.140296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:58.140306 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:58.140365 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:58.140650 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:58.141134 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:58.141884 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:58.142084 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:58.142134 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:58.144393 (+ 2259us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.129:35673: BlockingRecv error: recv got EOF from 127.28.213.129:35673 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":60,"threads_started":1}
Aug 08 17:50:58 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:58 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:58.257324 11154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:58.253113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.130:51961)
0808 17:50:58.253273 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:58.253285 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:58.253343 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:58.253463 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:58.253464 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:58.253628 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:58.253677 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:58.253678 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:58.254251 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:58.254251 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:58.254779 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:58.254780 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:58.255090 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:58.255091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:58.255126 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:58.255513 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:58.255517 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:58.257242 (+ 1725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":76,"threads_started":1}
W20260808 17:50:58.257359 11153 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:58.253165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:51961 (local address 127.28.213.190:40999)
0808 17:50:58.253265 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:58.253267 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:58.253336 (+ 69us) server_negotiation.cc:407] Connection header received
0808 17:50:58.253389 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:58.253390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:58.253407 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:58.253454 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:58.253722 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:58.254200 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:58.254843 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:58.255034 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:58.255087 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:58.257311 (+ 2224us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.130:51961: BlockingRecv error: recv got EOF from 127.28.213.130:51961 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 08 17:50:58 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:58 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:58.389567 11155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:58.385448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.131:39801)
0808 17:50:58.385586 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:58.385597 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:58.385648 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:58.385748 (+ 100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:58.385749 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:58.385911 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:58.385960 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:58.385962 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:58.386566 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:58.386567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:58.387094 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:58.387095 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:58.387363 (+ 268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:58.387364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:58.387400 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:58.387831 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:58.387836 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:58.389490 (+ 1654us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":85,"threads_started":1}
W20260808 17:50:58.389635 11153 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:58.385539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:39801 (local address 127.28.213.190:40999)
0808 17:50:58.385582 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:58.385585 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:58.385633 (+ 48us) server_negotiation.cc:407] Connection header received
0808 17:50:58.385686 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:58.385686 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:58.385697 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:58.385740 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:58.386007 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:58.386492 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:58.387151 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:58.387318 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:58.387357 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:58.389581 (+ 2224us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.131:39801: BlockingRecv error: recv got EOF from 127.28.213.131:39801 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Aug 08 17:50:59 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:59 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:59.153198 11156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:59.144830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.129:37003)
0808 17:50:59.144963 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:59.144973 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:59.145036 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:59.145207 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:59.145208 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:59.145454 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:59.145514 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:59.145517 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:59.146234 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:59.146235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:59.146782 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:59.146783 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:59.147086 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:59.147087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:59.147124 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:59.151444 (+ 4320us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:59.151448 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:59.153128 (+ 1680us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":73,"threads_started":1}
W20260808 17:50:59.153307 11157 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:59.144881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:37003 (local address 127.28.213.190:40999)
0808 17:50:59.145017 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:59.145019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:59.145028 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:50:59.145107 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:59.145108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:59.145118 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:59.145185 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:59.145613 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:59.146167 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:59.146841 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:59.147039 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:59.147080 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:59.153242 (+ 6162us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.129:37003: BlockingRecv error: recv got EOF from 127.28.213.129:37003 (error 108)
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":69,"threads_started":1}
Aug 08 17:50:59 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:59 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:59.261965 11158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:59.257713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.130:37707)
0808 17:50:59.257833 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:59.257843 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:59.257917 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:59.258043 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:59.258044 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:59.258208 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:59.258254 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:59.258256 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:59.258841 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:59.258841 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:59.259388 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:59.259390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:59.259667 (+ 277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:59.259667 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:59.259704 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:59.260091 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:59.260095 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:59.261886 (+ 1791us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":59,"threads_started":1}
W20260808 17:50:59.262041 11157 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:59.257765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:37707 (local address 127.28.213.190:40999)
0808 17:50:59.257831 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:59.257833 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:59.257906 (+ 73us) server_negotiation.cc:407] Connection header received
0808 17:50:59.257980 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:59.257981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:59.257992 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:59.258029 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:59.258304 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:59.258789 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:59.259445 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:59.259620 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:59.259664 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:59.261981 (+ 2317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.130:37707: BlockingRecv error: recv got EOF from 127.28.213.130:37707 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 08 17:50:59 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:50:59 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:50:59.394263 11160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:50:59.389992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.131:56277)
0808 17:50:59.390131 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 17:50:59.390141 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:50:59.390196 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:50:59.390302 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:50:59.390303 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:50:59.390483 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:50:59.390531 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:59.390533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:59.391117 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:59.391118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:59.391680 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:50:59.391681 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:50:59.391961 (+ 280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:50:59.391961 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:50:59.391998 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:59.392395 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:50:59.392407 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:50:59.394172 (+ 1765us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":75,"threads_started":1}
W20260808 17:50:59.394330 11157 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:50:59.390044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:56277 (local address 127.28.213.190:40999)
0808 17:50:59.390095 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 17:50:59.390096 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:50:59.390189 (+ 93us) server_negotiation.cc:407] Connection header received
0808 17:50:59.390236 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:50:59.390237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:50:59.390249 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:50:59.390290 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:50:59.390578 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:59.391064 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:59.391733 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:50:59.391905 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:50:59.391955 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:50:59.394277 (+ 2322us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.131:56277: BlockingRecv error: recv got EOF from 127.28.213.131:56277 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 08 17:51:00 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:51:00 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:51:00.157866 11162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:00.153624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.129:49213)
0808 17:51:00.153772 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:00.153782 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:00.153840 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:00.153966 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:00.153967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:00.154135 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:00.154182 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:00.154183 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:00.154776 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:00.154777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:00.155307 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:00.155308 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:00.155578 (+ 270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:00.155579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:00.155614 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:00.156008 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:51:00.156012 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:00.157807 (+ 1795us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":94,"threads_started":1}
W20260808 17:51:00.157979 11163 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:51:00.153680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:49213 (local address 127.28.213.190:40999)
0808 17:51:00.153793 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:00.153795 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:00.153836 (+ 41us) server_negotiation.cc:407] Connection header received
0808 17:51:00.153881 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:00.153881 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:00.153893 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:00.153957 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:00.154230 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:00.154727 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:00.155357 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:00.155534 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:00.155574 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:00.157890 (+ 2316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.129:49213: BlockingRecv error: recv got EOF from 127.28.213.129:49213 (error 108)
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":57,"threads_started":1}
Aug 08 17:51:00 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:51:00 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:51:00.266316 11164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:00.262354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.130:60317)
0808 17:51:00.262488 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:00.262498 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:00.262554 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:00.262666 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:00.262667 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:00.262831 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:00.262877 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:00.262879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:00.263456 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:00.263457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:00.263997 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:00.263998 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:00.264266 (+ 268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:00.264267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:00.264303 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:00.264677 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:51:00.264680 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:00.266235 (+ 1555us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":78,"threads_started":1}
W20260808 17:51:00.266395 11163 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:51:00.262429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:60317 (local address 127.28.213.190:40999)
0808 17:51:00.262489 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:00.262491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:00.262549 (+ 58us) server_negotiation.cc:407] Connection header received
0808 17:51:00.262596 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:00.262597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:00.262607 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:00.262654 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:00.262927 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:00.263402 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:00.264048 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:00.264221 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:00.264263 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:00.266331 (+ 2068us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.130:60317: BlockingRecv error: recv got EOF from 127.28.213.130:60317 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 08 17:51:00 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:51:00 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:51:00.398954 11165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:00.394704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.131:36281)
0808 17:51:00.394836 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:00.394848 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:00.394923 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:00.395044 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:00.395045 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:00.395230 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:00.395276 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:00.395278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:00.395917 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:00.395918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:00.396445 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:00.396447 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:00.396769 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:00.396770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:00.396825 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:00.397250 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:51:00.397255 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:00.398870 (+ 1615us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":69,"threads_started":1}
W20260808 17:51:00.399019 11163 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:51:00.394777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:36281 (local address 127.28.213.190:40999)
0808 17:51:00.394839 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:00.394842 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:00.394897 (+ 55us) server_negotiation.cc:407] Connection header received
0808 17:51:00.394972 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:00.394973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:00.394987 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:00.395033 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:00.395347 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:00.395833 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:00.396526 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:00.396711 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:00.396764 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:00.398965 (+ 2201us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.131:36281: BlockingRecv error: recv got EOF from 127.28.213.131:36281 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 08 17:51:01 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:51:01 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:51:01.162350 11166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:01.158259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.129:48449)
0808 17:51:01.158391 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:01.158409 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:01.158463 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:01.158590 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:01.158591 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:01.158759 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:01.158807 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:01.158809 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:01.159396 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:01.159396 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:01.159937 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:01.159939 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:01.160217 (+ 278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:01.160218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:01.160254 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:01.160647 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:51:01.160651 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:01.162281 (+ 1630us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":71,"threads_started":1}
W20260808 17:51:01.162461 11168 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:51:01.158319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:48449 (local address 127.28.213.190:40999)
0808 17:51:01.158431 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:01.158433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:01.158445 (+ 12us) server_negotiation.cc:407] Connection header received
0808 17:51:01.158512 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:01.158513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:01.158524 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:01.158580 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:01.158855 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:01.159344 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:01.159990 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:01.160171 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:01.160213 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:01.162387 (+ 2174us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.129:48449: BlockingRecv error: recv got EOF from 127.28.213.129:48449 (error 108)
Metrics: {"server-negotiator.queue_time_us":82,"thread_start_us":52,"threads_started":1}
Aug 08 17:51:01 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:51:01 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:51:01.271400 11169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:01.266846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.130:57379)
0808 17:51:01.266983 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:01.266997 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:01.267064 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:01.267188 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:01.267188 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:01.267372 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:01.267420 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:01.267422 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:01.268070 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:01.268072 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:01.268754 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:01.268758 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:01.269113 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:01.269114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:01.269169 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:01.269621 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:51:01.269626 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:01.271327 (+ 1701us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":63,"threads_started":1}
W20260808 17:51:01.271471 11168 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:51:01.266954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:57379 (local address 127.28.213.190:40999)
0808 17:51:01.267011 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:01.267014 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:01.267043 (+ 29us) server_negotiation.cc:407] Connection header received
0808 17:51:01.267114 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:01.267115 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:01.267127 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:01.267178 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:01.267487 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:01.268000 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:01.268820 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:01.269016 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:01.269069 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:01.271418 (+ 2349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.130:57379: BlockingRecv error: recv got EOF from 127.28.213.130:57379 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 08 17:51:01 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:51:01 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:51:01.403810 11170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:01.399405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.131:53059)
0808 17:51:01.399551 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:01.399562 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:01.399628 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:01.399759 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:01.399760 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:01.399948 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:01.399994 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:01.399996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:01.400622 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:01.400623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:01.401208 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:01.401211 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:01.401562 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:01.401563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:01.401622 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:01.402058 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:51:01.402062 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:01.403739 (+ 1677us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":86,"threads_started":1}
W20260808 17:51:01.403888 11168 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:51:01.399484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:53059 (local address 127.28.213.190:40999)
0808 17:51:01.399551 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:01.399553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:01.399616 (+ 63us) server_negotiation.cc:407] Connection header received
0808 17:51:01.399686 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:01.399687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:01.399702 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:01.399748 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:01.400063 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:01.400551 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:01.401316 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:01.401504 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:01.401556 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:01.403827 (+ 2271us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.131:53059: BlockingRecv error: recv got EOF from 127.28.213.131:53059 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 08 17:51:02 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:51:02 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:51:02.166980 11171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:02.162760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.129:54027)
0808 17:51:02.162887 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:02.162897 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:02.162951 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:02.163062 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:02.163062 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:02.163228 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:02.163277 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:02.163279 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:02.163875 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:02.163876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:02.164416 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:02.164418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:02.164694 (+ 276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:02.164694 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:02.164729 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:02.165178 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:51:02.165182 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:02.166901 (+ 1719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":71,"threads_started":1}
W20260808 17:51:02.167076 11172 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:51:02.162828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:54027 (local address 127.28.213.190:40999)
0808 17:51:02.162951 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:02.162952 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:02.162961 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:51:02.162986 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:02.162986 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:02.162997 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:02.163053 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:02.163329 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:02.163817 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:02.164468 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:02.164649 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:02.164690 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:02.167002 (+ 2312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.129:54027: BlockingRecv error: recv got EOF from 127.28.213.129:54027 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":50,"threads_started":1}
Aug 08 17:51:02 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:51:02 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:51:02.276262 11173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:02.271832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.130:45687)
0808 17:51:02.271978 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:02.271989 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:02.272057 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:02.272184 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:02.272185 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:02.272385 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:02.272447 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:02.272450 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:02.273180 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:02.273181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:02.273756 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:02.273758 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:02.274097 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:02.274099 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:02.274155 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:02.274534 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:51:02.274538 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:02.276201 (+ 1663us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":65,"threads_started":1}
W20260808 17:51:02.276363 11172 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:51:02.271903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:45687 (local address 127.28.213.190:40999)
0808 17:51:02.271975 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:02.271977 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:02.272046 (+ 69us) server_negotiation.cc:407] Connection header received
0808 17:51:02.272110 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:02.272111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:02.272123 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:02.272171 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:02.272510 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:02.273096 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:02.273833 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:02.274036 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:02.274091 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:02.276292 (+ 2201us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.130:45687: BlockingRecv error: recv got EOF from 127.28.213.130:45687 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 08 17:51:02 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:51:02 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.131@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:51:02.408222 11174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:02.404228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.131:36369)
0808 17:51:02.404345 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:02.404356 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:02.404424 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:02.404533 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:02.404534 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:02.404700 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:02.404748 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:02.404750 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:02.405354 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:02.405354 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:02.405876 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:02.405878 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:02.406143 (+ 265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:02.406144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:02.406178 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:02.406569 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:51:02.406572 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:02.408163 (+ 1591us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":56,"threads_started":1}
W20260808 17:51:02.408309 11172 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:51:02.404287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:36369 (local address 127.28.213.190:40999)
0808 17:51:02.404363 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:02.404365 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:02.404414 (+ 49us) server_negotiation.cc:407] Connection header received
0808 17:51:02.404463 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:02.404464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:02.404476 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:02.404522 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:02.404798 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:02.405305 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:02.405929 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:02.406100 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:02.406139 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:02.408249 (+ 2110us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.131:36369: BlockingRecv error: recv got EOF from 127.28.213.131:36369 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 17:51:03 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:51:03 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.129@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:51:03.171758 11176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:03.167523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.129:55715)
0808 17:51:03.167673 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:03.167683 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:03.167743 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:03.167865 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:03.167865 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:03.168031 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:03.168080 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:03.168082 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.168682 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.168683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:03.169248 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:03.169250 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.169544 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.169545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:03.169585 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:03.169977 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:51:03.169982 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:03.171669 (+ 1687us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":69,"threads_started":1}
W20260808 17:51:03.171831 11177 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:51:03.167575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:55715 (local address 127.28.213.190:40999)
0808 17:51:03.167693 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:03.167695 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:03.167727 (+ 32us) server_negotiation.cc:407] Connection header received
0808 17:51:03.167784 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:03.167784 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:03.167795 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:03.167851 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:03.168129 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.168616 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.169315 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.169500 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.169539 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:03.171771 (+ 2232us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.129:55715: BlockingRecv error: recv got EOF from 127.28.213.129:55715 (error 108)
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":59,"threads_started":1}
Aug 08 17:51:03 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 17:51:03 dist-test-slave-bndk krb5kdc[9565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.213.130@KRBTEST.COM for oryx/127.28.213.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 17:51:03.281245 11178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:03.276722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40999 (local address 127.28.213.130:60247)
0808 17:51:03.276850 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:03.276860 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:03.276923 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:03.277045 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:03.277045 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:03.277271 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:03.277331 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:03.277335 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.278061 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.278063 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:03.278638 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:03.278641 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.278957 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.278957 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:03.279008 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:03.279397 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:51:03.279402 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:03.281108 (+ 1706us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.213.190:40999: Server oryx/127.28.213.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":60,"threads_started":1}
W20260808 17:51:03.281278 11177 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:51:03.276777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:60247 (local address 127.28.213.190:40999)
0808 17:51:03.276822 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:03.276823 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:03.276900 (+ 77us) server_negotiation.cc:407] Connection header received
0808 17:51:03.276980 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:03.276981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:03.276991 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:03.277029 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:03.277407 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.277985 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.278704 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.278894 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.278951 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:03.281200 (+ 2249us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.213.130:60247: BlockingRecv error: recv got EOF from 127.28.213.130:60247 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:51:03.340704 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 10472
I20260808 17:51:03.353530 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 10712
I20260808 17:51:03.361959 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 10905
I20260808 17:51:03.367430 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 10363
2026-08-08T17:51:03Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17478 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T17:51:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:51:03Z Disabled control of system clock
I20260808 17:51:03.400956 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:34491
--webserver_interface=127.28.213.190
--webserver_port=0
--builtin_ntp_servers=127.28.213.148:32787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:34491
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 17:51:03.479001 11187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:51:03.479178 11187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:51:03.479197 11187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:51:03.480257 11187 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:51:03.480288 11187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:51:03.480299 11187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:51:03.480310 11187 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:51:03.480320 11187 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:51:03.481599 11187 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:32787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:34491
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:34491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11187
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:51:03.481775 11187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:51:03.481995 11187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:51:03.486517 11197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:03.486541 11187 server_base.cc:1034] running on GCE node
W20260808 17:51:03.486718 11194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:03.486810 11193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:03.487036 11187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:51:03.487303 11187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:51:03.488435 11187 hybrid_clock.cc:648] HybridClock initialized: now 1786211463488423 us; error 29 us; skew 500 ppm
I20260808 17:51:03.489579 11187 webserver.cc:460] Webserver started at http://127.28.213.190:41377/ using document root <none> and password file <none>
I20260808 17:51:03.489797 11187 fs_manager.cc:359] Metadata directory not provided
I20260808 17:51:03.489847 11187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:51:03.489979 11187 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:51:03.490918 11187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "8b429187561f44389719269327d5e1ff"
format_stamp: "Formatted at 2026-08-08 17:51:03 on dist-test-slave-bndk"
server_key: "ac0af8cb67d918f806134eaeebfc3381"
server_key_iv: "1e65e755e31c3291512f2597ef7f6da1"
server_key_version: "encryptionkey@0"
I20260808 17:51:03.491240 11187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "8b429187561f44389719269327d5e1ff"
format_stamp: "Formatted at 2026-08-08 17:51:03 on dist-test-slave-bndk"
server_key: "ac0af8cb67d918f806134eaeebfc3381"
server_key_iv: "1e65e755e31c3291512f2597ef7f6da1"
server_key_version: "encryptionkey@0"
I20260808 17:51:03.492446 11187 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:51:03.493048 11207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:03.493209 11187 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:51:03.493316 11187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "8b429187561f44389719269327d5e1ff"
format_stamp: "Formatted at 2026-08-08 17:51:03 on dist-test-slave-bndk"
server_key: "ac0af8cb67d918f806134eaeebfc3381"
server_key_iv: "1e65e755e31c3291512f2597ef7f6da1"
server_key_version: "encryptionkey@0"
I20260808 17:51:03.493372 11187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:51:03.502933 11187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:51:03.503171 11187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:51:03.503286 11187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:51:03.506978 11187 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:34491
I20260808 17:51:03.507009 11282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:34491 every 8 connection(s)
I20260808 17:51:03.507292 11187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:51:03.507889 11283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:51:03.510351 11283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff: Bootstrap starting.
I20260808 17:51:03.510869 11283 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff: Neither blocks nor log segments found. Creating new log.
I20260808 17:51:03.511101 11283 log.cc:824] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff: Log is configured to *not* fsync() on all Append() calls
I20260808 17:51:03.511685 11283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff: No bootstrap required, opened a new log
I20260808 17:51:03.513201 11283 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b429187561f44389719269327d5e1ff" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 34491 } }
I20260808 17:51:03.513409 11283 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:51:03.513442 11283 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b429187561f44389719269327d5e1ff, State: Initialized, Role: FOLLOWER
I20260808 17:51:03.513543 11283 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b429187561f44389719269327d5e1ff" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 34491 } }
I20260808 17:51:03.513593 11283 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:51:03.513612 11283 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:51:03.513640 11283 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:51:03.514082 11283 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b429187561f44389719269327d5e1ff" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 34491 } }
I20260808 17:51:03.514164 11283 leader_election.cc:302] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b429187561f44389719269327d5e1ff; no voters:
I20260808 17:51:03.514279 11283 leader_election.cc:288] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:51:03.514323 11288 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:51:03.514493 11283 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:51:03.514526 11288 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff [term 1 LEADER]: Becoming Leader. State: Replica: 8b429187561f44389719269327d5e1ff, State: Running, Role: LEADER
I20260808 17:51:03.514671 11288 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b429187561f44389719269327d5e1ff" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 34491 } }
I20260808 17:51:03.514786 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 11187
I20260808 17:51:03.514870 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:51:03.515076 29526 external_mini_cluster.cc:1428] Setting key 8620d2e14df332d22c396484c1d619ab
I20260808 17:51:03.515169 11290 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b429187561f44389719269327d5e1ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b429187561f44389719269327d5e1ff" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 34491 } } }
I20260808 17:51:03.515240 11290 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff [sys.catalog]: This master's current role is: LEADER
I20260808 17:51:03.515534 11291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b429187561f44389719269327d5e1ff. Latest consensus state: current_term: 1 leader_uuid: "8b429187561f44389719269327d5e1ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b429187561f44389719269327d5e1ff" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 34491 } } }
I20260808 17:51:03.515625 11291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff [sys.catalog]: This master's current role is: LEADER
I20260808 17:51:03.515799 11301 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:51:03.516343 11301 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:51:03.517838 11301 catalog_manager.cc:1347] Generated new cluster ID: d4f54ce41f644f6ea6b672237be680d6
I20260808 17:51:03.517894 11301 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:51:03.520376 11309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:03.515546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34002 (local address 127.28.213.190:34491)
0808 17:51:03.516050 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:03.516074 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:03.516105 (+ 31us) server_negotiation.cc:407] Connection header received
0808 17:51:03.516296 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:03.516302 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:03.516353 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:03.516476 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:03.516771 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.517953 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.518685 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.519097 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.519201 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:03.519794 (+ 593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:51:03.519798 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:51:03.519799 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:51:03.519971 (+ 172us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:51:03.520003 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:51:03.520013 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:51:03.520067 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:03.520140 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 17:51:03.520213 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":65,"threads_started":1}
I20260808 17:51:03.537921 11301 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:51:03.538370 11301 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:51:03.541891 11301 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b429187561f44389719269327d5e1ff: Generated new TSK 0
I20260808 17:51:03.542042 11301 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:51:03.543249 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:34491
--builtin_ntp_servers=127.28.213.148:32787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 17:51:03.623600 11319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:51:03.623783 11319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:51:03.623802 11319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:51:03.624895 11319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:51:03.624939 11319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:51:03.624961 11319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:51:03.626271 11319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:32787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:34491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:51:03.626490 11319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:51:03.626765 11319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:51:03.632319 11326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:03.632411 11325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:03.632567 11319 server_base.cc:1034] running on GCE node
W20260808 17:51:03.632319 11331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:03.632827 11319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:51:03.633050 11319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:51:03.634184 11319 hybrid_clock.cc:648] HybridClock initialized: now 1786211463634162 us; error 39 us; skew 500 ppm
I20260808 17:51:03.635295 11319 webserver.cc:460] Webserver started at http://127.28.213.129:37809/ using document root <none> and password file <none>
I20260808 17:51:03.635519 11319 fs_manager.cc:359] Metadata directory not provided
I20260808 17:51:03.635566 11319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:51:03.635690 11319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:51:03.636652 11319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "642ec9cb75fb424497b62e084c63bcfc"
format_stamp: "Formatted at 2026-08-08 17:51:03 on dist-test-slave-bndk"
server_key: "5647bcfce3da44a2d29e3813348ef1f2"
server_key_iv: "8295939ac760936ba744902e3e07053e"
server_key_version: "encryptionkey@0"
I20260808 17:51:03.636970 11319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "642ec9cb75fb424497b62e084c63bcfc"
format_stamp: "Formatted at 2026-08-08 17:51:03 on dist-test-slave-bndk"
server_key: "5647bcfce3da44a2d29e3813348ef1f2"
server_key_iv: "8295939ac760936ba744902e3e07053e"
server_key_version: "encryptionkey@0"
I20260808 17:51:03.638253 11319 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:51:03.638963 11340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:03.639114 11319 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:51:03.639204 11319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "642ec9cb75fb424497b62e084c63bcfc"
format_stamp: "Formatted at 2026-08-08 17:51:03 on dist-test-slave-bndk"
server_key: "5647bcfce3da44a2d29e3813348ef1f2"
server_key_iv: "8295939ac760936ba744902e3e07053e"
server_key_version: "encryptionkey@0"
I20260808 17:51:03.639268 11319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:51:03.647504 11319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:51:03.647739 11319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:51:03.647855 11319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:51:03.648036 11319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:51:03.648317 11319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:51:03.648350 11319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:03.648375 11319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:51:03.648399 11319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:03.653687 11319 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:34161
I20260808 17:51:03.653751 11524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:34161 every 8 connection(s)
I20260808 17:51:03.653998 11319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:51:03.658526 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 11319
I20260808 17:51:03.658613 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:51:03.658807 29526 external_mini_cluster.cc:1428] Setting key 7c6d96d6c9f06e88f8b412391ea4dbd8
I20260808 17:51:03.659665 11309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:03.654605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:41491 (local address 127.28.213.190:34491)
0808 17:51:03.654643 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:03.654645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:03.654861 (+ 216us) server_negotiation.cc:407] Connection header received
0808 17:51:03.655479 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:03.655480 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:03.655496 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:03.655570 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:03.656350 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.656877 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.657865 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.658071 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.658127 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:03.659362 (+ 1235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:51:03.659363 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:51:03.659363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:51:03.659367 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:51:03.659384 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:51:03.659389 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:51:03.659444 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:03.659556 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 17:51:03.659585 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:51:03.659783 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:34491
--builtin_ntp_servers=127.28.213.148:32787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 17:51:03.659869 11528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:03.654581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:34491 (local address 127.28.213.129:41491)
0808 17:51:03.654746 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:03.654786 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:03.655367 (+ 581us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:03.655639 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:03.655643 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:03.655653 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:03.656258 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:03.656264 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.656965 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.656966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:03.657782 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:03.657785 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.658141 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.658142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:03.658294 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:03.659022 (+ 728us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:51:03.659023 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:03.659060 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:51:03.659088 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:51:03.659472 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:51:03.659479 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:51:03.659483 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:51:03.659550 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 17:51:03.659655 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":78,"threads_started":1}
I20260808 17:51:03.660365 11525 heartbeater.cc:347] Connected to a master server at 127.28.213.190:34491
I20260808 17:51:03.660455 11525 heartbeater.cc:464] Registering TS with master...
I20260808 17:51:03.660615 11525 heartbeater.cc:511] Master 127.28.213.190:34491 requested a full tablet report, sending...
I20260808 17:51:03.661150 11230 ts_manager.cc:194] Registered new tserver with Master: 642ec9cb75fb424497b62e084c63bcfc (127.28.213.129:34161)
I20260808 17:51:03.662011 11230 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.213.129:41491
W20260808 17:51:03.742115 11529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:51:03.742296 11529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:51:03.742316 11529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:51:03.743423 11529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:51:03.743459 11529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:51:03.743490 11529 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:51:03.744765 11529 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:32787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:34491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11529
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:51:03.744978 11529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:51:03.745250 11529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:51:03.749735 11542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:03.749787 11540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:03.749728 11546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:03.749967 11529 server_base.cc:1034] running on GCE node
I20260808 17:51:03.750177 11529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:51:03.750389 11529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:51:03.751536 11529 hybrid_clock.cc:648] HybridClock initialized: now 1786211463751521 us; error 28 us; skew 500 ppm
I20260808 17:51:03.752635 11529 webserver.cc:460] Webserver started at http://127.28.213.130:35603/ using document root <none> and password file <none>
I20260808 17:51:03.752835 11529 fs_manager.cc:359] Metadata directory not provided
I20260808 17:51:03.752882 11529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:51:03.753007 11529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:51:03.754017 11529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "8fc8429984c74b6f863ce51b019582e1"
format_stamp: "Formatted at 2026-08-08 17:51:03 on dist-test-slave-bndk"
server_key: "da2b6e898b8df290b9ce54c4af098c07"
server_key_iv: "085f165e3e692240b72ee3d9ad910ad8"
server_key_version: "encryptionkey@0"
I20260808 17:51:03.754339 11529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "8fc8429984c74b6f863ce51b019582e1"
format_stamp: "Formatted at 2026-08-08 17:51:03 on dist-test-slave-bndk"
server_key: "da2b6e898b8df290b9ce54c4af098c07"
server_key_iv: "085f165e3e692240b72ee3d9ad910ad8"
server_key_version: "encryptionkey@0"
I20260808 17:51:03.755496 11529 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:51:03.756115 11556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:03.756269 11529 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:51:03.756346 11529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "8fc8429984c74b6f863ce51b019582e1"
format_stamp: "Formatted at 2026-08-08 17:51:03 on dist-test-slave-bndk"
server_key: "da2b6e898b8df290b9ce54c4af098c07"
server_key_iv: "085f165e3e692240b72ee3d9ad910ad8"
server_key_version: "encryptionkey@0"
I20260808 17:51:03.756420 11529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:51:03.765758 11529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:51:03.765976 11529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:51:03.766088 11529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:51:03.766268 11529 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:51:03.766543 11529 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:51:03.766577 11529 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:03.766601 11529 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:51:03.766628 11529 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:03.771847 11529 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:36321
I20260808 17:51:03.771907 11736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:36321 every 8 connection(s)
I20260808 17:51:03.772154 11529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:51:03.776046 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 11529
I20260808 17:51:03.776120 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:51:03.776307 29526 external_mini_cluster.cc:1428] Setting key f00144a3a1a7d8ba93e47eee8523a62d
I20260808 17:51:03.776856 11309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:03.772777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:34763 (local address 127.28.213.190:34491)
0808 17:51:03.772825 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:03.772827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:03.773021 (+ 194us) server_negotiation.cc:407] Connection header received
0808 17:51:03.773542 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:03.773543 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:03.773556 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:03.773604 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:03.774224 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.774710 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.775631 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.775818 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.775873 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:03.776628 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:51:03.776629 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:51:03.776629 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:51:03.776633 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:51:03.776649 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:51:03.776653 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:51:03.776693 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:03.776774 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 17:51:03.776797 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:51:03.777086 11742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:03.772738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:34491 (local address 127.28.213.130:34763)
0808 17:51:03.772922 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:03.772951 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:03.773444 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:03.773678 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:03.773682 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:03.773692 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:03.774141 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:03.774146 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.774795 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.774796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:03.775548 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:03.775550 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.775889 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.775891 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:03.776019 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:03.776496 (+ 477us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:51:03.776497 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:03.776528 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:51:03.776549 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:51:03.776699 (+ 150us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:51:03.776704 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:51:03.776707 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:51:03.776773 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 17:51:03.776867 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":81,"threads_started":1}
I20260808 17:51:03.777307 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:34491
--builtin_ntp_servers=127.28.213.148:32787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 17:51:03.777565 11737 heartbeater.cc:347] Connected to a master server at 127.28.213.190:34491
I20260808 17:51:03.777652 11737 heartbeater.cc:464] Registering TS with master...
I20260808 17:51:03.777813 11737 heartbeater.cc:511] Master 127.28.213.190:34491 requested a full tablet report, sending...
I20260808 17:51:03.778152 11230 ts_manager.cc:194] Registered new tserver with Master: 8fc8429984c74b6f863ce51b019582e1 (127.28.213.130:36321)
I20260808 17:51:03.778520 11230 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.213.130:34763
W20260808 17:51:03.855743 11745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:51:03.855930 11745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:51:03.855950 11745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:51:03.857044 11745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:51:03.857082 11745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:51:03.857108 11745 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:51:03.858390 11745 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:32787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:34491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:51:03.858592 11745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:51:03.858853 11745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:51:03.863298 11757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:03.863289 11754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:03.863289 11753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:03.863415 11745 server_base.cc:1034] running on GCE node
I20260808 17:51:03.863703 11745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:51:03.863920 11745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:51:03.865056 11745 hybrid_clock.cc:648] HybridClock initialized: now 1786211463865040 us; error 29 us; skew 500 ppm
I20260808 17:51:03.866251 11745 webserver.cc:460] Webserver started at http://127.28.213.131:44561/ using document root <none> and password file <none>
I20260808 17:51:03.866458 11745 fs_manager.cc:359] Metadata directory not provided
I20260808 17:51:03.866508 11745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:51:03.866632 11745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:51:03.867605 11745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "9ed8e8eea79f4f1a811bc0ccef5865c5"
format_stamp: "Formatted at 2026-08-08 17:51:03 on dist-test-slave-bndk"
server_key: "caa31b6daa790076a6f3ccd964a2ade9"
server_key_iv: "c98b82fe570be07a7a091741ee53ed4d"
server_key_version: "encryptionkey@0"
I20260808 17:51:03.867926 11745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "9ed8e8eea79f4f1a811bc0ccef5865c5"
format_stamp: "Formatted at 2026-08-08 17:51:03 on dist-test-slave-bndk"
server_key: "caa31b6daa790076a6f3ccd964a2ade9"
server_key_iv: "c98b82fe570be07a7a091741ee53ed4d"
server_key_version: "encryptionkey@0"
I20260808 17:51:03.869095 11745 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:51:03.869801 11769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:03.869944 11745 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:03.870024 11745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "9ed8e8eea79f4f1a811bc0ccef5865c5"
format_stamp: "Formatted at 2026-08-08 17:51:03 on dist-test-slave-bndk"
server_key: "caa31b6daa790076a6f3ccd964a2ade9"
server_key_iv: "c98b82fe570be07a7a091741ee53ed4d"
server_key_version: "encryptionkey@0"
I20260808 17:51:03.870090 11745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:51:03.882388 11745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:51:03.882627 11745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:51:03.882743 11745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:51:03.882932 11745 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:51:03.883206 11745 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:51:03.883239 11745 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:03.883265 11745 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:51:03.883282 11745 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:03.888571 11745 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:45415
I20260808 17:51:03.888605 11940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:45415 every 8 connection(s)
I20260808 17:51:03.888872 11745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:51:03.892244 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 11745
I20260808 17:51:03.892325 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:51:03.892501 29526 external_mini_cluster.cc:1428] Setting key e089314780532a5c8cd9e6f34e8887c3
I20260808 17:51:03.893623 11309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:03.889492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:60529 (local address 127.28.213.190:34491)
0808 17:51:03.889554 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:03.889556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:03.889735 (+ 179us) server_negotiation.cc:407] Connection header received
0808 17:51:03.890179 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:03.890180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:03.890189 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:03.890239 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:03.890809 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.891298 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.892210 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.892426 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.892473 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:03.893356 (+ 883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:51:03.893357 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:51:03.893357 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:51:03.893362 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:51:03.893379 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:51:03.893383 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:51:03.893431 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:03.893515 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 17:51:03.893545 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 17:51:03.893801 11943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:03.889452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:34491 (local address 127.28.213.131:60529)
0808 17:51:03.889624 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:03.889661 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:03.890101 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:03.890289 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:03.890291 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:03.890300 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:03.890751 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:03.890755 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.891355 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.891355 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:03.892140 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:03.892144 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:03.892496 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:03.892497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:03.892647 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:03.893168 (+ 521us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:51:03.893168 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:03.893193 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:51:03.893276 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:51:03.893444 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:51:03.893451 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:51:03.893454 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:51:03.893518 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 17:51:03.893615 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":81,"threads_started":1}
I20260808 17:51:03.894177 11941 heartbeater.cc:347] Connected to a master server at 127.28.213.190:34491
I20260808 17:51:03.894264 11941 heartbeater.cc:464] Registering TS with master...
I20260808 17:51:03.894433 11941 heartbeater.cc:511] Master 127.28.213.190:34491 requested a full tablet report, sending...
I20260808 17:51:03.894740 11230 ts_manager.cc:194] Registered new tserver with Master: 9ed8e8eea79f4f1a811bc0ccef5865c5 (127.28.213.131:45415)
I20260808 17:51:03.895062 11230 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.213.131:60529
I20260808 17:51:03.904043 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 17:51:03.905639 11309 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:51:03.905177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34018 (local address 127.28.213.190:34491)
0808 17:51:03.905239 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:03.905241 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:03.905337 (+ 96us) server_negotiation.cc:407] Connection header received
0808 17:51:03.905398 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:03.905399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:03.905418 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:03.905461 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:03.905591 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34018: BlockingRecv error: recv got EOF from 127.0.0.1:34018 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:51:03.905822 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 11319
I20260808 17:51:03.921753 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 11529
I20260808 17:51:03.932904 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 11745
I20260808 17:51:03.939060 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 11187
2026-08-08T17:51:03Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (571 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T17:51:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:51:03Z Disabled control of system clock
I20260808 17:51:03.971845 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:35749
--webserver_interface=127.28.213.190
--webserver_port=0
--builtin_ntp_servers=127.28.213.148:44831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:35749
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 17:51:04.049922 11958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:51:04.050103 11958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:51:04.050122 11958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:51:04.051147 11958 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:51:04.051180 11958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:51:04.051191 11958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:51:04.051203 11958 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:51:04.051218 11958 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:51:04.052486 11958 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:44831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:35749
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:35749
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:51:04.052670 11958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:51:04.052889 11958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:51:04.057134 11964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:04.057286 11958 server_base.cc:1034] running on GCE node
W20260808 17:51:04.057145 11965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:04.057152 11967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:04.057626 11958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:51:04.057845 11958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:51:04.058974 11958 hybrid_clock.cc:648] HybridClock initialized: now 1786211464058961 us; error 29 us; skew 500 ppm
I20260808 17:51:04.065969 11958 webserver.cc:460] Webserver started at http://127.28.213.190:38623/ using document root <none> and password file <none>
I20260808 17:51:04.066186 11958 fs_manager.cc:359] Metadata directory not provided
I20260808 17:51:04.066233 11958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:51:04.066354 11958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:51:04.067296 11958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "81b3e985bd2146be80edef0d716c0b83"
format_stamp: "Formatted at 2026-08-08 17:51:04 on dist-test-slave-bndk"
server_key: "0c9e7d79e1ccef26352c5419136cfc23"
server_key_iv: "311a292aa1859572d2f0dbbd889d579e"
server_key_version: "encryptionkey@0"
I20260808 17:51:04.067616 11958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "81b3e985bd2146be80edef0d716c0b83"
format_stamp: "Formatted at 2026-08-08 17:51:04 on dist-test-slave-bndk"
server_key: "0c9e7d79e1ccef26352c5419136cfc23"
server_key_iv: "311a292aa1859572d2f0dbbd889d579e"
server_key_version: "encryptionkey@0"
I20260808 17:51:04.068763 11958 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:51:04.069422 11975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:04.069547 11958 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:04.069628 11958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "81b3e985bd2146be80edef0d716c0b83"
format_stamp: "Formatted at 2026-08-08 17:51:04 on dist-test-slave-bndk"
server_key: "0c9e7d79e1ccef26352c5419136cfc23"
server_key_iv: "311a292aa1859572d2f0dbbd889d579e"
server_key_version: "encryptionkey@0"
I20260808 17:51:04.069686 11958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:51:04.072803 11958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:51:04.073033 11958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:51:04.073148 11958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:51:04.076804 11958 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:35749
I20260808 17:51:04.076838 12061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:35749 every 8 connection(s)
I20260808 17:51:04.077117 11958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:51:04.077757 12062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:51:04.080274 12062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83: Bootstrap starting.
I20260808 17:51:04.080789 12062 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83: Neither blocks nor log segments found. Creating new log.
I20260808 17:51:04.081069 12062 log.cc:824] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83: Log is configured to *not* fsync() on all Append() calls
I20260808 17:51:04.081679 12062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83: No bootstrap required, opened a new log
I20260808 17:51:04.083166 12062 raft_consensus.cc:348] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81b3e985bd2146be80edef0d716c0b83" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35749 } }
I20260808 17:51:04.083292 12062 raft_consensus.cc:374] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:51:04.083323 12062 raft_consensus.cc:729] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b3e985bd2146be80edef0d716c0b83, State: Initialized, Role: FOLLOWER
I20260808 17:51:04.083451 12062 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81b3e985bd2146be80edef0d716c0b83" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35749 } }
I20260808 17:51:04.083511 12062 raft_consensus.cc:388] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:51:04.083534 12062 raft_consensus.cc:482] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:51:04.083576 12062 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:51:04.084064 12062 raft_consensus.cc:504] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81b3e985bd2146be80edef0d716c0b83" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35749 } }
I20260808 17:51:04.084153 12062 leader_election.cc:302] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 81b3e985bd2146be80edef0d716c0b83; no voters:
I20260808 17:51:04.084295 12062 leader_election.cc:288] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:51:04.084354 12069 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:51:04.084523 12062 sys_catalog.cc:564] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:51:04.084529 12069 raft_consensus.cc:686] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83 [term 1 LEADER]: Becoming Leader. State: Replica: 81b3e985bd2146be80edef0d716c0b83, State: Running, Role: LEADER
I20260808 17:51:04.084695 12069 consensus_queue.cc:237] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81b3e985bd2146be80edef0d716c0b83" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35749 } }
I20260808 17:51:04.085322 12071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81b3e985bd2146be80edef0d716c0b83. Latest consensus state: current_term: 1 leader_uuid: "81b3e985bd2146be80edef0d716c0b83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81b3e985bd2146be80edef0d716c0b83" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35749 } } }
I20260808 17:51:04.085398 12071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83 [sys.catalog]: This master's current role is: LEADER
I20260808 17:51:04.085757 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 11958
I20260808 17:51:04.085762 12084 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:51:04.085856 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:51:04.085873 12070 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "81b3e985bd2146be80edef0d716c0b83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81b3e985bd2146be80edef0d716c0b83" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35749 } } }
I20260808 17:51:04.085937 12070 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83 [sys.catalog]: This master's current role is: LEADER
I20260808 17:51:04.086050 29526 external_mini_cluster.cc:1428] Setting key 26b45753cbe6c50c1f067e333946d609
I20260808 17:51:04.086251 12084 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:51:04.087700 12084 catalog_manager.cc:1347] Generated new cluster ID: 1f843cac180d4ebf88296dc3f477f0e8
I20260808 17:51:04.087751 12084 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:51:04.088281 12100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:04.086605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52936 (local address 127.28.213.190:35749)
0808 17:51:04.086790 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:04.086797 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:04.086822 (+ 25us) server_negotiation.cc:407] Connection header received
0808 17:51:04.086927 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:04.086934 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:04.086985 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:04.087114 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:04.087877 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:51:04.087880 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:51:04.087880 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:51:04.087883 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:51:04.087913 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:51:04.087922 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:51:04.087974 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:04.088049 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 17:51:04.088106 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":77,"threads_started":1}
I20260808 17:51:04.102957 12084 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:51:04.103096 12084 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:51:04.109788 12084 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 81b3e985bd2146be80edef0d716c0b83: Generated new TSK 0
I20260808 17:51:04.109953 12084 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:51:04.112555 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:35749
--builtin_ntp_servers=127.28.213.148:44831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 17:51:04.194180 12104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:51:04.194386 12104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:51:04.194416 12104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:51:04.195529 12104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:51:04.195565 12104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:51:04.195598 12104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:51:04.196892 12104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:44831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:35749
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:51:04.197108 12104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:51:04.197414 12104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:51:04.202045 12109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:04.202050 12112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:04.202240 12110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:04.202716 12104 server_base.cc:1034] running on GCE node
I20260808 17:51:04.202913 12104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:51:04.203131 12104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:51:04.204278 12104 hybrid_clock.cc:648] HybridClock initialized: now 1786211464204260 us; error 33 us; skew 500 ppm
I20260808 17:51:04.208141 12104 webserver.cc:460] Webserver started at http://127.28.213.129:44169/ using document root <none> and password file <none>
I20260808 17:51:04.208400 12104 fs_manager.cc:359] Metadata directory not provided
I20260808 17:51:04.208452 12104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:51:04.208624 12104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:51:04.209707 12104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "c9a8c6f5fad2417a970b2cfcdb778268"
format_stamp: "Formatted at 2026-08-08 17:51:04 on dist-test-slave-bndk"
server_key: "4168ce34e83fb5794ea3daf6c24c48db"
server_key_iv: "685a87c6999ca666f3c1fd26bc74c860"
server_key_version: "encryptionkey@0"
I20260808 17:51:04.210036 12104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "c9a8c6f5fad2417a970b2cfcdb778268"
format_stamp: "Formatted at 2026-08-08 17:51:04 on dist-test-slave-bndk"
server_key: "4168ce34e83fb5794ea3daf6c24c48db"
server_key_iv: "685a87c6999ca666f3c1fd26bc74c860"
server_key_version: "encryptionkey@0"
I20260808 17:51:04.211218 12104 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:51:04.211867 12125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:04.212028 12104 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:51:04.212109 12104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "c9a8c6f5fad2417a970b2cfcdb778268"
format_stamp: "Formatted at 2026-08-08 17:51:04 on dist-test-slave-bndk"
server_key: "4168ce34e83fb5794ea3daf6c24c48db"
server_key_iv: "685a87c6999ca666f3c1fd26bc74c860"
server_key_version: "encryptionkey@0"
I20260808 17:51:04.212175 12104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:51:04.215616 12104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:51:04.215852 12104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:51:04.215970 12104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:51:04.216153 12104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:51:04.216437 12104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:51:04.216470 12104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:04.216495 12104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:51:04.216521 12104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:04.221938 12104 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:32845
I20260808 17:51:04.221997 12299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:32845 every 8 connection(s)
I20260808 17:51:04.222262 12104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:51:04.224958 12100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:04.222901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:40967 (local address 127.28.213.190:35749)
0808 17:51:04.222960 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:04.222962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:04.223167 (+ 205us) server_negotiation.cc:407] Connection header received
0808 17:51:04.223623 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:04.223625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:04.223633 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:04.223680 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:04.224702 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:51:04.224703 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:51:04.224704 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:51:04.224708 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:51:04.224725 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:51:04.224731 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:51:04.224780 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:04.224876 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 17:51:04.224892 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 17:51:04.225127 12303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:04.222863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:35749 (local address 127.28.213.129:40967)
0808 17:51:04.223061 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:04.223092 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:04.223533 (+ 441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:04.223746 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:04.223750 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:04.223760 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:04.224565 (+ 805us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:51:04.224565 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:04.224591 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:51:04.224619 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:51:04.224778 (+ 159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:51:04.224785 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:51:04.224787 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:51:04.224886 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 17:51:04.224944 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":94,"threads_started":1}
I20260808 17:51:04.225611 12300 heartbeater.cc:347] Connected to a master server at 127.28.213.190:35749
I20260808 17:51:04.225700 12300 heartbeater.cc:464] Registering TS with master...
I20260808 17:51:04.225834 12300 heartbeater.cc:511] Master 127.28.213.190:35749 requested a full tablet report, sending...
I20260808 17:51:04.226336 11999 ts_manager.cc:194] Registered new tserver with Master: c9a8c6f5fad2417a970b2cfcdb778268 (127.28.213.129:32845)
I20260808 17:51:04.228022 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 12104
I20260808 17:51:04.228101 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:51:04.228268 29526 external_mini_cluster.cc:1428] Setting key 6b42e41ec2159f536489f0dce86662f1
I20260808 17:51:04.229120 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:35749
--builtin_ntp_servers=127.28.213.148:44831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 17:51:04.321406 12304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:51:04.321611 12304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:51:04.321640 12304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:51:04.322784 12304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:51:04.322824 12304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:51:04.322856 12304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:51:04.324155 12304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:44831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:35749
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12304
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:51:04.324389 12304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:51:04.324659 12304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:51:04.329353 12314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:04.329360 12315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:04.329360 12318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:04.329527 12304 server_base.cc:1034] running on GCE node
I20260808 17:51:04.329772 12304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:51:04.330008 12304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:51:04.331148 12304 hybrid_clock.cc:648] HybridClock initialized: now 1786211464331130 us; error 30 us; skew 500 ppm
I20260808 17:51:04.332379 12304 webserver.cc:460] Webserver started at http://127.28.213.130:41143/ using document root <none> and password file <none>
I20260808 17:51:04.332623 12304 fs_manager.cc:359] Metadata directory not provided
I20260808 17:51:04.332674 12304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:51:04.332815 12304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:51:04.333943 12304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "d3aa9f2d8f6443c98c8008376b5766d7"
format_stamp: "Formatted at 2026-08-08 17:51:04 on dist-test-slave-bndk"
server_key: "9d2349d4657b2ce871604a2e25b81777"
server_key_iv: "27ad278afe2b89688b8b96f34a58fc51"
server_key_version: "encryptionkey@0"
I20260808 17:51:04.334278 12304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "d3aa9f2d8f6443c98c8008376b5766d7"
format_stamp: "Formatted at 2026-08-08 17:51:04 on dist-test-slave-bndk"
server_key: "9d2349d4657b2ce871604a2e25b81777"
server_key_iv: "27ad278afe2b89688b8b96f34a58fc51"
server_key_version: "encryptionkey@0"
I20260808 17:51:04.335461 12304 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:51:04.336077 12326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:04.336231 12304 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:51:04.336313 12304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "d3aa9f2d8f6443c98c8008376b5766d7"
format_stamp: "Formatted at 2026-08-08 17:51:04 on dist-test-slave-bndk"
server_key: "9d2349d4657b2ce871604a2e25b81777"
server_key_iv: "27ad278afe2b89688b8b96f34a58fc51"
server_key_version: "encryptionkey@0"
I20260808 17:51:04.336380 12304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:51:04.339581 12304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:51:04.339812 12304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:51:04.339926 12304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:51:04.340099 12304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:51:04.340375 12304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:51:04.340409 12304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:04.340433 12304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:51:04.340459 12304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:04.346199 12304 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:33943
I20260808 17:51:04.346271 12504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:33943 every 8 connection(s)
I20260808 17:51:04.346526 12304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:51:04.349308 12100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:04.347212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:54559 (local address 127.28.213.190:35749)
0808 17:51:04.347267 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:04.347268 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:04.347470 (+ 202us) server_negotiation.cc:407] Connection header received
0808 17:51:04.347909 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:04.347911 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:04.347918 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:04.347976 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:04.349049 (+ 1073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:51:04.349051 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:51:04.349051 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:51:04.349056 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:51:04.349074 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:51:04.349079 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:51:04.349129 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:04.349196 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 17:51:04.349210 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 17:51:04.349479 12508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:04.347172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:35749 (local address 127.28.213.130:54559)
0808 17:51:04.347348 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:04.347384 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:04.347815 (+ 431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:04.348043 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:04.348047 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:04.348057 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:04.348908 (+ 851us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:51:04.348909 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:04.348934 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:51:04.348960 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:51:04.349131 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:51:04.349137 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:51:04.349140 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:51:04.349207 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 17:51:04.349295 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":82,"threads_started":1}
I20260808 17:51:04.349913 12505 heartbeater.cc:347] Connected to a master server at 127.28.213.190:35749
I20260808 17:51:04.349993 12505 heartbeater.cc:464] Registering TS with master...
I20260808 17:51:04.350126 12505 heartbeater.cc:511] Master 127.28.213.190:35749 requested a full tablet report, sending...
I20260808 17:51:04.350461 11999 ts_manager.cc:194] Registered new tserver with Master: d3aa9f2d8f6443c98c8008376b5766d7 (127.28.213.130:33943)
I20260808 17:51:04.354269 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 12304
I20260808 17:51:04.354370 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:51:04.354522 29526 external_mini_cluster.cc:1428] Setting key b70963fe4f5106c25b4a60040f923d5d
I20260808 17:51:04.355257 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:35749
--builtin_ntp_servers=127.28.213.148:44831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 17:51:04.434466 12509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:51:04.434643 12509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:51:04.434662 12509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:51:04.435729 12509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:51:04.435762 12509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:51:04.435786 12509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:51:04.437041 12509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:44831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:35749
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:51:04.437258 12509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:51:04.437508 12509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:51:04.441936 12520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:04.441985 12528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:04.441942 12525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:04.441957 12509 server_base.cc:1034] running on GCE node
I20260808 17:51:04.442356 12509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:51:04.442580 12509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:51:04.443722 12509 hybrid_clock.cc:648] HybridClock initialized: now 1786211464443708 us; error 31 us; skew 500 ppm
I20260808 17:51:04.444836 12509 webserver.cc:460] Webserver started at http://127.28.213.131:41223/ using document root <none> and password file <none>
I20260808 17:51:04.445065 12509 fs_manager.cc:359] Metadata directory not provided
I20260808 17:51:04.445113 12509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:51:04.445252 12509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:51:04.446218 12509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "59949e19d84d452da0b110b80744fcdb"
format_stamp: "Formatted at 2026-08-08 17:51:04 on dist-test-slave-bndk"
server_key: "009625628e8939858ad6fb4552893ec7"
server_key_iv: "eadda98b85237e09fb30fcb88496b287"
server_key_version: "encryptionkey@0"
I20260808 17:51:04.446532 12509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "59949e19d84d452da0b110b80744fcdb"
format_stamp: "Formatted at 2026-08-08 17:51:04 on dist-test-slave-bndk"
server_key: "009625628e8939858ad6fb4552893ec7"
server_key_iv: "eadda98b85237e09fb30fcb88496b287"
server_key_version: "encryptionkey@0"
I20260808 17:51:04.447667 12509 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:51:04.448278 12538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:04.448431 12509 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:51:04.448509 12509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "59949e19d84d452da0b110b80744fcdb"
format_stamp: "Formatted at 2026-08-08 17:51:04 on dist-test-slave-bndk"
server_key: "009625628e8939858ad6fb4552893ec7"
server_key_iv: "eadda98b85237e09fb30fcb88496b287"
server_key_version: "encryptionkey@0"
I20260808 17:51:04.448575 12509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:51:04.451719 12509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:51:04.451942 12509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:51:04.452062 12509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:51:04.452239 12509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:51:04.452508 12509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:51:04.452541 12509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:04.452565 12509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:51:04.452591 12509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:04.457919 12509 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:39275
I20260808 17:51:04.457980 12719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:39275 every 8 connection(s)
I20260808 17:51:04.458225 12509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:51:04.460171 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 12509
I20260808 17:51:04.460255 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:51:04.460428 29526 external_mini_cluster.cc:1428] Setting key 2abc0f48a4a313afa0fcd16f78a314ed
I20260808 17:51:04.460736 12100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:04.458818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:49853 (local address 127.28.213.190:35749)
0808 17:51:04.458878 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:04.458880 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:04.459064 (+ 184us) server_negotiation.cc:407] Connection header received
0808 17:51:04.459449 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:04.459450 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:04.459454 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:04.459505 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:04.460511 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:51:04.460512 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:51:04.460512 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:51:04.460517 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:51:04.460531 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:51:04.460536 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:51:04.460586 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:04.460652 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 17:51:04.460667 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 17:51:04.460973 12722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:04.458778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:35749 (local address 127.28.213.131:49853)
0808 17:51:04.458956 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:04.458991 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:04.459377 (+ 386us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:04.459552 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:04.459555 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:04.459563 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:04.460375 (+ 812us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:51:04.460375 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:04.460401 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:51:04.460429 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:51:04.460588 (+ 159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:51:04.460593 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:51:04.460596 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:51:04.460662 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 17:51:04.460718 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":81,"threads_started":1}
I20260808 17:51:04.461404 12720 heartbeater.cc:347] Connected to a master server at 127.28.213.190:35749
I20260808 17:51:04.461485 12720 heartbeater.cc:464] Registering TS with master...
I20260808 17:51:04.461615 12720 heartbeater.cc:511] Master 127.28.213.190:35749 requested a full tablet report, sending...
I20260808 17:51:04.461930 11999 ts_manager.cc:194] Registered new tserver with Master: 59949e19d84d452da0b110b80744fcdb (127.28.213.131:39275)
I20260808 17:51:04.471828 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 17:51:04.473644 12100 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:51:04.473162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52952 (local address 127.28.213.190:35749)
0808 17:51:04.473212 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:04.473232 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:04.473355 (+ 123us) server_negotiation.cc:407] Connection header received
0808 17:51:04.473423 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:04.473424 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:04.473429 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:04.473474 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:04.473583 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52952: BlockingRecv error: recv got EOF from 127.0.0.1:52952 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:51:04.473704 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 12104
I20260808 17:51:04.489082 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 12304
I20260808 17:51:04.500739 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 12509
I20260808 17:51:04.510098 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 11958
2026-08-08T17:51:04Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (573 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:51:04 dist-test-slave-bndk krb5kdc[12735](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:51:04 dist-test-slave-bndk krb5kdc[12735](info): set up 2 sockets
Aug 08 17:51:04 dist-test-slave-bndk krb5kdc[12735](info): commencing operation
krb5kdc: starting...
W20260808 17:51:05.635850 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:51:05 dist-test-slave-bndk krb5kdc[12735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:51:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:51:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:51:05.745787 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:43431
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:43431
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:51:05.824741 12757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:51:05.824934 12757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:51:05.824955 12757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:51:05.826114 12757 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:51:05.826159 12757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:51:05.826171 12757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:51:05.826195 12757 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:51:05.826220 12757 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:51:05.827636 12757 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:43431
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:43431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:51:05.827852 12757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:51:05.828056 12757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:51:05.832430 12764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:05.832446 12765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:05.832536 12769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:05.832686 12757 server_base.cc:1034] running on GCE node
I20260808 17:51:05.832875 12757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:51:05.833112 12757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:51:05.834247 12757 hybrid_clock.cc:648] HybridClock initialized: now 1786211465834234 us; error 29 us; skew 500 ppm
Aug 08 17:51:05 dist-test-slave-bndk krb5kdc[12735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211465, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:51:05.836524 12757 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:51:05.836886 12757 webserver.cc:460] Webserver started at http://127.28.213.190:39185/ using document root <none> and password file <none>
I20260808 17:51:05.837075 12757 fs_manager.cc:359] Metadata directory not provided
I20260808 17:51:05.837119 12757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:51:05.837210 12757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:51:05.838207 12757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "89df69a6db5b44a691cbd0133859821f"
format_stamp: "Formatted at 2026-08-08 17:51:05 on dist-test-slave-bndk"
server_key: "d63b862d3e01680837e0f17bd239d469"
server_key_iv: "72773cc7fa8beafcc3a57c87eba6464f"
server_key_version: "encryptionkey@0"
I20260808 17:51:05.838508 12757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "89df69a6db5b44a691cbd0133859821f"
format_stamp: "Formatted at 2026-08-08 17:51:05 on dist-test-slave-bndk"
server_key: "d63b862d3e01680837e0f17bd239d469"
server_key_iv: "72773cc7fa8beafcc3a57c87eba6464f"
server_key_version: "encryptionkey@0"
I20260808 17:51:05.839648 12757 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:51:05.840286 12786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:05.840436 12757 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:51:05.840514 12757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "89df69a6db5b44a691cbd0133859821f"
format_stamp: "Formatted at 2026-08-08 17:51:05 on dist-test-slave-bndk"
server_key: "d63b862d3e01680837e0f17bd239d469"
server_key_iv: "72773cc7fa8beafcc3a57c87eba6464f"
server_key_version: "encryptionkey@0"
I20260808 17:51:05.840577 12757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:51:05.864598 12757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:51:05.866861 12757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:51:05.866997 12757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:51:05.870669 12757 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:43431
I20260808 17:51:05.870707 12858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:43431 every 8 connection(s)
I20260808 17:51:05.870985 12757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:51:05.871874 12859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:51:05.874059 12859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f: Bootstrap starting.
I20260808 17:51:05.874606 12859 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f: Neither blocks nor log segments found. Creating new log.
I20260808 17:51:05.874861 12859 log.cc:824] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f: Log is configured to *not* fsync() on all Append() calls
I20260808 17:51:05.875486 12859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f: No bootstrap required, opened a new log
I20260808 17:51:05.877020 12859 raft_consensus.cc:348] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89df69a6db5b44a691cbd0133859821f" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 43431 } }
I20260808 17:51:05.877151 12859 raft_consensus.cc:374] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:51:05.877183 12859 raft_consensus.cc:729] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89df69a6db5b44a691cbd0133859821f, State: Initialized, Role: FOLLOWER
I20260808 17:51:05.877331 12859 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89df69a6db5b44a691cbd0133859821f" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 43431 } }
I20260808 17:51:05.877394 12859 raft_consensus.cc:388] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:51:05.877439 12859 raft_consensus.cc:482] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:51:05.877485 12859 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:51:05.878221 12859 raft_consensus.cc:504] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89df69a6db5b44a691cbd0133859821f" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 43431 } }
I20260808 17:51:05.878315 12859 leader_election.cc:302] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 89df69a6db5b44a691cbd0133859821f; no voters:
I20260808 17:51:05.878473 12859 leader_election.cc:288] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:51:05.878522 12862 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:51:05.878672 12862 raft_consensus.cc:686] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f [term 1 LEADER]: Becoming Leader. State: Replica: 89df69a6db5b44a691cbd0133859821f, State: Running, Role: LEADER
I20260808 17:51:05.878706 12859 sys_catalog.cc:564] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:51:05.878769 12862 consensus_queue.cc:237] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89df69a6db5b44a691cbd0133859821f" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 43431 } }
I20260808 17:51:05.879122 12863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "89df69a6db5b44a691cbd0133859821f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89df69a6db5b44a691cbd0133859821f" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 43431 } } }
I20260808 17:51:05.879148 12864 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89df69a6db5b44a691cbd0133859821f. Latest consensus state: current_term: 1 leader_uuid: "89df69a6db5b44a691cbd0133859821f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89df69a6db5b44a691cbd0133859821f" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 43431 } } }
I20260808 17:51:05.879215 12863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f [sys.catalog]: This master's current role is: LEADER
I20260808 17:51:05.879217 12864 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f [sys.catalog]: This master's current role is: LEADER
I20260808 17:51:05.879436 12876 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:51:05.879932 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 12757
I20260808 17:51:05.880033 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:51:05.880232 29526 external_mini_cluster.cc:1428] Setting key fc11ac07142b42221dcadb51f813fe43
I20260808 17:51:05.880599 12876 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:51:05.882058 12876 catalog_manager.cc:1347] Generated new cluster ID: b4e88fa5345945d89bec190e2de5e1f9
I20260808 17:51:05.882107 12876 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:51:05 dist-test-slave-bndk krb5kdc[12735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:51:05.891515 12892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:05.880636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46460 (local address 127.28.213.190:43431)
0808 17:51:05.880950 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:05.880959 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:05.881291 (+ 332us) server_negotiation.cc:407] Connection header received
0808 17:51:05.881436 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:05.881442 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:05.881482 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:05.881607 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:05.882377 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:05.883729 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:05.884767 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:05.885353 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:05.885448 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:05.888026 (+ 2578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:51:05.888030 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:51:05.888030 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:51:05.888041 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:51:05.889893 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:05.890253 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:05.890256 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:05.890257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:05.890363 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:05.890526 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:05.890527 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:05.890527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:05.890807 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:51:05.890960 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:05.891023 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 17:51:05.891265 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":75,"threads_started":1}
I20260808 17:51:05.903455 12876 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:51:05.904143 12876 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:51:05.916196 12876 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f: Generated new TSK 0
I20260808 17:51:05.916358 12876 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
I20260808 17:51:05.943552 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:43431
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:51:06.022770 12903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:51:06.022958 12903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:51:06.022990 12903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:51:06.024099 12903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:51:06.024140 12903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:51:06.024173 12903 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:51:06.025632 12903 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:43431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:51:06.025856 12903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:51:06.026062 12903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:51:06.030591 12911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:06.030684 12910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:06.030702 12903 server_base.cc:1034] running on GCE node
W20260808 17:51:06.030622 12917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:06.030930 12903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:51:06.031137 12903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:51:06.032274 12903 hybrid_clock.cc:648] HybridClock initialized: now 1786211466032255 us; error 35 us; skew 500 ppm
Aug 08 17:51:06 dist-test-slave-bndk krb5kdc[12735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211466, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:51:06.034550 12903 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:51:06.034925 12903 webserver.cc:460] Webserver started at http://127.28.213.129:45697/ using document root <none> and password file <none>
I20260808 17:51:06.035106 12903 fs_manager.cc:359] Metadata directory not provided
I20260808 17:51:06.035151 12903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:51:06.035269 12903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:51:06.036212 12903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "696f8a428d234b2b9af31896bc4734a1"
format_stamp: "Formatted at 2026-08-08 17:51:06 on dist-test-slave-bndk"
server_key: "dd905c14e1593a31b3d7753331f90128"
server_key_iv: "40f7ca93330882c3e35fe5ea436c20cd"
server_key_version: "encryptionkey@0"
I20260808 17:51:06.036538 12903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "696f8a428d234b2b9af31896bc4734a1"
format_stamp: "Formatted at 2026-08-08 17:51:06 on dist-test-slave-bndk"
server_key: "dd905c14e1593a31b3d7753331f90128"
server_key_iv: "40f7ca93330882c3e35fe5ea436c20cd"
server_key_version: "encryptionkey@0"
I20260808 17:51:06.037946 12903 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:51:06.038584 12931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:06.038733 12903 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:51:06.038813 12903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "696f8a428d234b2b9af31896bc4734a1"
format_stamp: "Formatted at 2026-08-08 17:51:06 on dist-test-slave-bndk"
server_key: "dd905c14e1593a31b3d7753331f90128"
server_key_iv: "40f7ca93330882c3e35fe5ea436c20cd"
server_key_version: "encryptionkey@0"
I20260808 17:51:06.038872 12903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:51:06.047776 12903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:51:06.049376 12903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:51:06.049512 12903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:51:06.049701 12903 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:51:06.049968 12903 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:51:06.050001 12903 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:06.050027 12903 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:51:06.050045 12903 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:06.055460 12903 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:39303
I20260808 17:51:06.055521 13100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:39303 every 8 connection(s)
I20260808 17:51:06.055774 12903 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:51:06.058153 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 12903
I20260808 17:51:06.058228 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:51:06.058382 29526 external_mini_cluster.cc:1428] Setting key f7ba763ecb73101b99fd5f191bd32b02
Aug 08 17:51:06 dist-test-slave-bndk krb5kdc[12735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211466, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:51:06.064781 12892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:06.056409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:60163 (local address 127.28.213.190:43431)
0808 17:51:06.056485 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:06.056487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:06.056634 (+ 147us) server_negotiation.cc:407] Connection header received
0808 17:51:06.057083 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:06.057083 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:06.057093 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:06.057141 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:06.058012 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.058584 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.059678 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.059951 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.060023 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:06.062163 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:51:06.062165 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:51:06.062165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:51:06.062172 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:51:06.063442 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:06.063912 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:06.063913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:06.063913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:06.063964 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:06.064210 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:06.064211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:06.064211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:06.064300 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:51:06.064345 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:06.064643 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 17:51:06.064716 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 17:51:06.065006 13107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:06.056372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:43431 (local address 127.28.213.129:60163)
0808 17:51:06.056526 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:06.056561 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:06.057007 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:06.057192 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:06.057195 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:06.057750 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:06.057933 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:06.057938 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.058670 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.058671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:06.059584 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:06.059587 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.060024 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.060025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:06.060115 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:06.060554 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:51:06.060563 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:06.062082 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:51:06.063536 (+ 1454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:51:06.063545 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:51:06.063548 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:51:06.063838 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:51:06.064018 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:51:06.064019 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:51:06.064019 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:51:06.064152 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:51:06.064353 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:51:06.064359 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:51:06.064514 (+ 155us) client_negotiation.cc:769] Sending connection context
0808 17:51:06.064625 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 17:51:06.064785 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":73,"threads_started":1}
I20260808 17:51:06.065523 13102 heartbeater.cc:347] Connected to a master server at 127.28.213.190:43431
I20260808 17:51:06.065622 13102 heartbeater.cc:464] Registering TS with master...
I20260808 17:51:06.065802 13102 heartbeater.cc:511] Master 127.28.213.190:43431 requested a full tablet report, sending...
I20260808 17:51:06.066298 12813 ts_manager.cc:194] Registered new tserver with Master: 696f8a428d234b2b9af31896bc4734a1 (127.28.213.129:39303)
I20260808 17:51:06.066890 12813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:60163
WARNING: no policy specified for kudu/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
I20260808 17:51:06.083031 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:43431
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:51:06.161442 13115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:51:06.161628 13115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:51:06.161656 13115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:51:06.162755 13115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:51:06.162796 13115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:51:06.162830 13115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:51:06.164461 13115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:43431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13115
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:51:06.164706 13115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:51:06.164945 13115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:51:06.169694 13120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:06.169829 13115 server_base.cc:1034] running on GCE node
W20260808 17:51:06.169699 13124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:06.169863 13122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:06.170106 13115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:51:06.170295 13115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:51:06.171423 13115 hybrid_clock.cc:648] HybridClock initialized: now 1786211466171411 us; error 29 us; skew 500 ppm
Aug 08 17:51:06 dist-test-slave-bndk krb5kdc[12735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211466, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:51:06.173777 13115 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:51:06.174168 13115 webserver.cc:460] Webserver started at http://127.28.213.130:43125/ using document root <none> and password file <none>
I20260808 17:51:06.174351 13115 fs_manager.cc:359] Metadata directory not provided
I20260808 17:51:06.174393 13115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:51:06.174512 13115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:51:06.175464 13115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "14b566bbb54449349c639977d120703d"
format_stamp: "Formatted at 2026-08-08 17:51:06 on dist-test-slave-bndk"
server_key: "c1652578aa7e26ef5f4ccbd25f438d6b"
server_key_iv: "fc5e47c599fbf22dc5611e5ddc730ee8"
server_key_version: "encryptionkey@0"
I20260808 17:51:06.175774 13115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "14b566bbb54449349c639977d120703d"
format_stamp: "Formatted at 2026-08-08 17:51:06 on dist-test-slave-bndk"
server_key: "c1652578aa7e26ef5f4ccbd25f438d6b"
server_key_iv: "fc5e47c599fbf22dc5611e5ddc730ee8"
server_key_version: "encryptionkey@0"
I20260808 17:51:06.176986 13115 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:51:06.177721 13137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:06.177865 13115 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:06.177943 13115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "14b566bbb54449349c639977d120703d"
format_stamp: "Formatted at 2026-08-08 17:51:06 on dist-test-slave-bndk"
server_key: "c1652578aa7e26ef5f4ccbd25f438d6b"
server_key_iv: "fc5e47c599fbf22dc5611e5ddc730ee8"
server_key_version: "encryptionkey@0"
I20260808 17:51:06.178014 13115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:51:06.186417 13115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:51:06.188313 13115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:51:06.188441 13115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:51:06.188629 13115 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:51:06.188881 13115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:51:06.188921 13115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:06.188946 13115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:51:06.188970 13115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:06.194420 13115 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:45445
I20260808 17:51:06.194451 13296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:45445 every 8 connection(s)
I20260808 17:51:06.194703 13115 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:51:06.197052 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 13115
I20260808 17:51:06.197139 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:51:06.197336 29526 external_mini_cluster.cc:1428] Setting key eb4f0f5280540cc57566e1f87569a741
Aug 08 17:51:06 dist-test-slave-bndk krb5kdc[12735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211466, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:51:06.203293 12892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:06.195295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:54529 (local address 127.28.213.190:43431)
0808 17:51:06.195371 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:06.195374 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:06.195515 (+ 141us) server_negotiation.cc:407] Connection header received
0808 17:51:06.195919 (+ 404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:06.195921 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:06.195930 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:06.195977 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:06.196781 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.197364 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.198420 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.198690 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.198757 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:06.200810 (+ 2053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:51:06.200812 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:51:06.200812 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:51:06.200818 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:51:06.202003 (+ 1185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:06.202452 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:06.202453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:06.202453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:06.202503 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:06.202746 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:06.202746 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:06.202746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:06.202837 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:51:06.202880 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:06.203169 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 17:51:06.203231 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 17:51:06.203526 13300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:06.195257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:43431 (local address 127.28.213.130:54529)
0808 17:51:06.195404 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:06.195439 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:06.195846 (+ 407us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:06.196027 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:06.196030 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:06.196529 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:06.196714 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:06.196718 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.197473 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.197475 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:06.198339 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:06.198342 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.198768 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.198768 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:06.198858 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:06.199256 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:51:06.199264 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:06.200727 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:51:06.202086 (+ 1359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:51:06.202093 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:51:06.202096 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:51:06.202381 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:51:06.202560 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:51:06.202561 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:51:06.202561 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:51:06.202691 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:51:06.202888 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:51:06.202893 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:51:06.203045 (+ 152us) client_negotiation.cc:769] Sending connection context
0808 17:51:06.203162 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 17:51:06.203314 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":79,"threads_started":1}
I20260808 17:51:06.203989 13298 heartbeater.cc:347] Connected to a master server at 127.28.213.190:43431
I20260808 17:51:06.204082 13298 heartbeater.cc:464] Registering TS with master...
I20260808 17:51:06.204259 13298 heartbeater.cc:511] Master 127.28.213.190:43431 requested a full tablet report, sending...
I20260808 17:51:06.204605 12813 ts_manager.cc:194] Registered new tserver with Master: 14b566bbb54449349c639977d120703d (127.28.213.130:45445)
I20260808 17:51:06.204954 12813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:54529
WARNING: no policy specified for kudu/127.28.213.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
I20260808 17:51:06.221752 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:43431
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:51:06.300164 13306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:51:06.300352 13306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:51:06.300374 13306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:51:06.301499 13306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:51:06.301538 13306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:51:06.301566 13306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:51:06.302973 13306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:43431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:51:06.303186 13306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:51:06.303393 13306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:51:06.308198 13312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:06.308185 13311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:06.308269 13306 server_base.cc:1034] running on GCE node
W20260808 17:51:06.308176 13315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:06.308540 13306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:51:06.308782 13306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:51:06.309914 13306 hybrid_clock.cc:648] HybridClock initialized: now 1786211466309901 us; error 25 us; skew 500 ppm
Aug 08 17:51:06 dist-test-slave-bndk krb5kdc[12735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211466, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:51:06.312224 13306 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:51:06.312628 13306 webserver.cc:460] Webserver started at http://127.28.213.131:42005/ using document root <none> and password file <none>
I20260808 17:51:06.312835 13306 fs_manager.cc:359] Metadata directory not provided
I20260808 17:51:06.312884 13306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:51:06.313014 13306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:51:06.314005 13306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "ca53e5f5583348099218fb2ab7f9af76"
format_stamp: "Formatted at 2026-08-08 17:51:06 on dist-test-slave-bndk"
server_key: "b97c3cfd5ed7190774fd32c56223e865"
server_key_iv: "2aaf2f2fd11cd55a7127521aaa8cda89"
server_key_version: "encryptionkey@0"
I20260808 17:51:06.314340 13306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "ca53e5f5583348099218fb2ab7f9af76"
format_stamp: "Formatted at 2026-08-08 17:51:06 on dist-test-slave-bndk"
server_key: "b97c3cfd5ed7190774fd32c56223e865"
server_key_iv: "2aaf2f2fd11cd55a7127521aaa8cda89"
server_key_version: "encryptionkey@0"
I20260808 17:51:06.315543 13306 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:51:06.316191 13324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:06.316375 13306 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:51:06.316457 13306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "ca53e5f5583348099218fb2ab7f9af76"
format_stamp: "Formatted at 2026-08-08 17:51:06 on dist-test-slave-bndk"
server_key: "b97c3cfd5ed7190774fd32c56223e865"
server_key_iv: "2aaf2f2fd11cd55a7127521aaa8cda89"
server_key_version: "encryptionkey@0"
I20260808 17:51:06.316524 13306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:51:06.325187 13306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:51:06.327171 13306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:51:06.327308 13306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:51:06.327495 13306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:51:06.327759 13306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:51:06.327793 13306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:06.327819 13306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:51:06.327836 13306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:06.333081 13306 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:34259
I20260808 17:51:06.333118 13489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:34259 every 8 connection(s)
I20260808 17:51:06.333428 13306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:51:06.335745 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 13306
I20260808 17:51:06.335848 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:51:06.336009 29526 external_mini_cluster.cc:1428] Setting key 935616d774fd332d5ed718ef4809c24f
Aug 08 17:51:06 dist-test-slave-bndk krb5kdc[12735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211466, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:51:06.341512 12892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:06.334018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:51725 (local address 127.28.213.190:43431)
0808 17:51:06.334071 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:06.334074 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:06.334223 (+ 149us) server_negotiation.cc:407] Connection header received
0808 17:51:06.334680 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:06.334682 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:06.334695 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:06.334747 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:06.335605 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.336160 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.337203 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.337426 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.337481 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:06.339261 (+ 1780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:51:06.339262 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:51:06.339263 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:51:06.339270 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:51:06.340272 (+ 1002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:06.340619 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:06.340621 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:06.340621 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:06.340674 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:06.340900 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:06.340901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:06.340901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:06.341012 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:51:06.341068 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:06.341325 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 17:51:06.341405 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 17:51:06.341663 13493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:06.333982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:43431 (local address 127.28.213.131:51725)
0808 17:51:06.334116 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:06.334155 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:06.334589 (+ 434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:06.334820 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:06.334824 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:06.335330 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:06.335510 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:06.335515 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.336237 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.336238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:06.337126 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:06.337129 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.337495 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.337496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:06.337606 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:06.337954 (+ 348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:51:06.337961 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:06.339178 (+ 1217us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:51:06.340342 (+ 1164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:51:06.340349 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:51:06.340351 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:51:06.340555 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:51:06.340749 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:51:06.340750 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:51:06.340750 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:51:06.340842 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:51:06.341067 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:51:06.341073 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:51:06.341191 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 17:51:06.341303 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 17:51:06.341476 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":65,"threads_started":1}
I20260808 17:51:06.342043 13490 heartbeater.cc:347] Connected to a master server at 127.28.213.190:43431
I20260808 17:51:06.342131 13490 heartbeater.cc:464] Registering TS with master...
I20260808 17:51:06.342295 13490 heartbeater.cc:511] Master 127.28.213.190:43431 requested a full tablet report, sending...
I20260808 17:51:06.342638 12813 ts_manager.cc:194] Registered new tserver with Master: ca53e5f5583348099218fb2ab7f9af76 (127.28.213.131:34259)
I20260808 17:51:06.342967 12813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:51725
I20260808 17:51:06.347445 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:51:06.353628 12892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:06.348622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46466 (local address 127.28.213.190:43431)
0808 17:51:06.348653 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:06.348655 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:06.348763 (+ 108us) server_negotiation.cc:407] Connection header received
0808 17:51:06.348817 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:06.348817 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:06.348824 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:06.348866 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:06.349375 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.349831 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.350521 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.350690 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.350733 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:06.351804 (+ 1071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:51:06.351804 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:51:06.351805 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:51:06.351808 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:51:06.352767 (+ 959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:06.353039 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:06.353040 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:06.353040 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:06.353081 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:06.353206 (+ 125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:06.353207 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:06.353207 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:06.353362 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:51:06.353435 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:06.353521 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 17:51:06.353574 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260808 17:51:06.355007 12813 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46466:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:51:06.356622 12813 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:51:06.362416 13505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:06.358594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:39303 (local address 127.0.0.1:42768)
0808 17:51:06.358738 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:06.358770 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:06.358851 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:06.359140 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:06.359143 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:06.359145 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:51:06.359205 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:06.359206 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.360150 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.360151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:06.361284 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:06.361287 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.362219 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.362220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:06.362270 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:06.362273 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:51:06.362325 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 17:51:06.362352 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"spinlock_wait_cycles":384,"thread_start_us":55,"threads_started":1}
I20260808 17:51:06.362428 13509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:06.358683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45122 (local address 127.28.213.130:45445)
0808 17:51:06.358878 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:06.358883 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:06.359019 (+ 136us) server_negotiation.cc:407] Connection header received
0808 17:51:06.359059 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:06.359062 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:06.359078 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:06.359141 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:51:06.359407 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.360514 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.361528 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.362047 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.362119 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:06.362172 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:06.362299 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 17:51:06.362340 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":92,"threads_started":1}
I20260808 17:51:06.362653 13510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:06.358683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42768 (local address 127.28.213.129:39303)
0808 17:51:06.358975 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:06.358978 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:06.358989 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:51:06.359029 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:06.359032 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:06.359046 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:06.359127 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:51:06.359288 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.360059 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.361383 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.362076 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.362135 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:06.362189 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:06.362532 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 17:51:06.362579 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":94,"threads_started":1}
I20260808 17:51:06.362416 13511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:06.358596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:45445 (local address 127.0.0.1:45122)
0808 17:51:06.358892 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:06.358903 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:06.358964 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:06.359208 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:06.359209 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:06.359211 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:51:06.359315 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:06.359317 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.360614 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.360615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:06.361456 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:06.361459 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.362130 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.362131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:06.362204 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:06.362218 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 17:51:06.362282 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 17:51:06.362332 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":10,"thread_start_us":52,"threads_started":1}
I20260808 17:51:06.362926 13512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:06.358944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41886 (local address 127.28.213.131:34259)
0808 17:51:06.359102 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:06.359106 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:06.359115 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:51:06.359143 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:06.359145 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:06.359158 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:06.359232 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:51:06.359426 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.360485 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.361983 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.362623 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.362683 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:06.362732 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:06.362822 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 17:51:06.362855 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":75,"threads_started":1}
I20260808 17:51:06.362928 13506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:06.358764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:34259 (local address 127.0.0.1:41886)
0808 17:51:06.358955 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:06.358963 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:06.359002 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:06.359242 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:06.359243 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:06.359245 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:51:06.359349 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:06.359351 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.360593 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.360594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:06.361902 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:06.361905 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.362696 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.362697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:06.362756 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:06.362759 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:51:06.362809 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 17:51:06.362849 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":28,"thread_start_us":83,"threads_started":1}
I20260808 17:51:06.363288 13002 tablet_service.cc:1467] Processing CreateTablet for tablet 3375f6a1f6374a588b734324c04ac277 (DEFAULT_TABLE table=test-table [id=6fa5954ecc564982a7955aeeda43fcba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:51:06.363547 13200 tablet_service.cc:1467] Processing CreateTablet for tablet 3375f6a1f6374a588b734324c04ac277 (DEFAULT_TABLE table=test-table [id=6fa5954ecc564982a7955aeeda43fcba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:51:06.363526 13401 tablet_service.cc:1467] Processing CreateTablet for tablet 3375f6a1f6374a588b734324c04ac277 (DEFAULT_TABLE table=test-table [id=6fa5954ecc564982a7955aeeda43fcba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:51:06.363636 13002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3375f6a1f6374a588b734324c04ac277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:51:06.363847 13401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3375f6a1f6374a588b734324c04ac277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:51:06.363847 13200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3375f6a1f6374a588b734324c04ac277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:51:06.366115 13514 tablet_bootstrap.cc:492] T 3375f6a1f6374a588b734324c04ac277 P 696f8a428d234b2b9af31896bc4734a1: Bootstrap starting.
I20260808 17:51:06.366688 13514 tablet_bootstrap.cc:654] T 3375f6a1f6374a588b734324c04ac277 P 696f8a428d234b2b9af31896bc4734a1: Neither blocks nor log segments found. Creating new log.
I20260808 17:51:06.367102 13519 tablet_bootstrap.cc:492] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76: Bootstrap starting.
I20260808 17:51:06.367184 13514 log.cc:824] T 3375f6a1f6374a588b734324c04ac277 P 696f8a428d234b2b9af31896bc4734a1: Log is configured to *not* fsync() on all Append() calls
I20260808 17:51:06.367533 13517 tablet_bootstrap.cc:492] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d: Bootstrap starting.
I20260808 17:51:06.367849 13519 tablet_bootstrap.cc:654] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76: Neither blocks nor log segments found. Creating new log.
I20260808 17:51:06.367990 13514 tablet_bootstrap.cc:492] T 3375f6a1f6374a588b734324c04ac277 P 696f8a428d234b2b9af31896bc4734a1: No bootstrap required, opened a new log
I20260808 17:51:06.368060 13514 ts_tablet_manager.cc:1397] T 3375f6a1f6374a588b734324c04ac277 P 696f8a428d234b2b9af31896bc4734a1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:51:06.368160 13517 tablet_bootstrap.cc:654] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d: Neither blocks nor log segments found. Creating new log.
I20260808 17:51:06.368377 13519 log.cc:824] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76: Log is configured to *not* fsync() on all Append() calls
I20260808 17:51:06.368654 13517 log.cc:824] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d: Log is configured to *not* fsync() on all Append() calls
I20260808 17:51:06.369088 13519 tablet_bootstrap.cc:492] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76: No bootstrap required, opened a new log
I20260808 17:51:06.369158 13519 ts_tablet_manager.cc:1397] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:51:06.369413 13517 tablet_bootstrap.cc:492] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d: No bootstrap required, opened a new log
I20260808 17:51:06.369481 13517 ts_tablet_manager.cc:1397] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:51:06.369828 13514 raft_consensus.cc:348] T 3375f6a1f6374a588b734324c04ac277 P 696f8a428d234b2b9af31896bc4734a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14b566bbb54449349c639977d120703d" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45445 } } peers { permanent_uuid: "696f8a428d234b2b9af31896bc4734a1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 39303 } } peers { permanent_uuid: "ca53e5f5583348099218fb2ab7f9af76" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34259 } }
I20260808 17:51:06.369994 13514 raft_consensus.cc:374] T 3375f6a1f6374a588b734324c04ac277 P 696f8a428d234b2b9af31896bc4734a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:51:06.370035 13514 raft_consensus.cc:729] T 3375f6a1f6374a588b734324c04ac277 P 696f8a428d234b2b9af31896bc4734a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 696f8a428d234b2b9af31896bc4734a1, State: Initialized, Role: FOLLOWER
I20260808 17:51:06.370147 13514 consensus_queue.cc:260] T 3375f6a1f6374a588b734324c04ac277 P 696f8a428d234b2b9af31896bc4734a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14b566bbb54449349c639977d120703d" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45445 } } peers { permanent_uuid: "696f8a428d234b2b9af31896bc4734a1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 39303 } } peers { permanent_uuid: "ca53e5f5583348099218fb2ab7f9af76" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34259 } }
I20260808 17:51:06.370430 13514 ts_tablet_manager.cc:1428] T 3375f6a1f6374a588b734324c04ac277 P 696f8a428d234b2b9af31896bc4734a1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:51:06.370430 13102 heartbeater.cc:503] Master 127.28.213.190:43431 was elected leader, sending a full tablet report...
I20260808 17:51:06.370982 13519 raft_consensus.cc:348] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14b566bbb54449349c639977d120703d" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45445 } } peers { permanent_uuid: "696f8a428d234b2b9af31896bc4734a1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 39303 } } peers { permanent_uuid: "ca53e5f5583348099218fb2ab7f9af76" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34259 } }
I20260808 17:51:06.371137 13519 raft_consensus.cc:374] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:51:06.371178 13519 raft_consensus.cc:729] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca53e5f5583348099218fb2ab7f9af76, State: Initialized, Role: FOLLOWER
I20260808 17:51:06.371317 13519 consensus_queue.cc:260] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14b566bbb54449349c639977d120703d" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45445 } } peers { permanent_uuid: "696f8a428d234b2b9af31896bc4734a1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 39303 } } peers { permanent_uuid: "ca53e5f5583348099218fb2ab7f9af76" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34259 } }
I20260808 17:51:06.371244 13517 raft_consensus.cc:348] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14b566bbb54449349c639977d120703d" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45445 } } peers { permanent_uuid: "696f8a428d234b2b9af31896bc4734a1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 39303 } } peers { permanent_uuid: "ca53e5f5583348099218fb2ab7f9af76" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34259 } }
I20260808 17:51:06.371403 13517 raft_consensus.cc:374] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:51:06.371446 13517 raft_consensus.cc:729] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14b566bbb54449349c639977d120703d, State: Initialized, Role: FOLLOWER
I20260808 17:51:06.371589 13519 ts_tablet_manager.cc:1428] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 17:51:06.371554 13517 consensus_queue.cc:260] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14b566bbb54449349c639977d120703d" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45445 } } peers { permanent_uuid: "696f8a428d234b2b9af31896bc4734a1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 39303 } } peers { permanent_uuid: "ca53e5f5583348099218fb2ab7f9af76" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34259 } }
I20260808 17:51:06.371623 13490 heartbeater.cc:503] Master 127.28.213.190:43431 was elected leader, sending a full tablet report...
I20260808 17:51:06.371806 13517 ts_tablet_manager.cc:1428] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:51:06.371833 13298 heartbeater.cc:503] Master 127.28.213.190:43431 was elected leader, sending a full tablet report...
W20260808 17:51:06.445188 13299 tablet.cc:2369] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:51:06.507215 13528 raft_consensus.cc:482] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:51:06.507332 13528 raft_consensus.cc:504] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14b566bbb54449349c639977d120703d" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45445 } } peers { permanent_uuid: "696f8a428d234b2b9af31896bc4734a1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 39303 } } peers { permanent_uuid: "ca53e5f5583348099218fb2ab7f9af76" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34259 } }
I20260808 17:51:06.507722 13528 leader_election.cc:288] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 696f8a428d234b2b9af31896bc4734a1 (127.28.213.129:39303), ca53e5f5583348099218fb2ab7f9af76 (127.28.213.131:34259)
I20260808 17:51:06.510448 13510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:06.507975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:48677 (local address 127.28.213.129:39303)
0808 17:51:06.508044 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:06.508046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:06.508055 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:51:06.508115 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:06.508117 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:06.508127 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:06.508183 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:51:06.508337 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.508805 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.509748 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.510123 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.510185 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:06.510194 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:06.510345 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 17:51:06.510380 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 17:51:06.510440 13300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:06.507918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:39303 (local address 127.28.213.130:48677)
0808 17:51:06.507979 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:06.507992 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:06.508047 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:06.508201 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:06.508202 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:06.508204 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:51:06.508270 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:06.508272 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.508880 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.508881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:06.509655 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:06.509657 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.510199 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.510200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:06.510280 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:06.510283 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:51:06.510329 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 17:51:06.510367 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 17:51:06.510591 13529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:06.508027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:34259 (local address 127.28.213.130:60499)
0808 17:51:06.508215 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:06.508224 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:06.508276 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:06.508386 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:06.508387 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:06.508389 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:51:06.508467 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:06.508468 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.509064 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.509065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:06.509831 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:06.509834 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.510352 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.510353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:06.510429 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:06.510433 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:51:06.510476 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 17:51:06.510512 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":120,"threads_started":1}
I20260808 17:51:06.510583 13512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:06.508132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:60499 (local address 127.28.213.131:34259)
0808 17:51:06.508191 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:06.508193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:06.508278 (+ 85us) server_negotiation.cc:407] Connection header received
0808 17:51:06.508324 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:06.508325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:06.508333 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:06.508378 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:51:06.508526 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.508997 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.509926 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.510282 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.510343 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:06.510350 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:06.510487 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 17:51:06.510520 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 17:51:06.510792 13030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3375f6a1f6374a588b734324c04ac277" candidate_uuid: "14b566bbb54449349c639977d120703d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "696f8a428d234b2b9af31896bc4734a1" is_pre_election: true
I20260808 17:51:06.510962 13030 raft_consensus.cc:2454] T 3375f6a1f6374a588b734324c04ac277 P 696f8a428d234b2b9af31896bc4734a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14b566bbb54449349c639977d120703d in term 0.
I20260808 17:51:06.511190 13138 leader_election.cc:302] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14b566bbb54449349c639977d120703d, 696f8a428d234b2b9af31896bc4734a1; no voters:
I20260808 17:51:06.511320 13528 raft_consensus.cc:2781] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:51:06.511371 13528 raft_consensus.cc:482] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:51:06.511312 13429 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3375f6a1f6374a588b734324c04ac277" candidate_uuid: "14b566bbb54449349c639977d120703d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca53e5f5583348099218fb2ab7f9af76" is_pre_election: true
I20260808 17:51:06.511385 13528 raft_consensus.cc:3037] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:51:06.511447 13429 raft_consensus.cc:2454] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14b566bbb54449349c639977d120703d in term 0.
I20260808 17:51:06.512137 13528 raft_consensus.cc:504] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14b566bbb54449349c639977d120703d" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45445 } } peers { permanent_uuid: "696f8a428d234b2b9af31896bc4734a1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 39303 } } peers { permanent_uuid: "ca53e5f5583348099218fb2ab7f9af76" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34259 } }
I20260808 17:51:06.512244 13528 leader_election.cc:288] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [CANDIDATE]: Term 1 election: Requested vote from peers 696f8a428d234b2b9af31896bc4734a1 (127.28.213.129:39303), ca53e5f5583348099218fb2ab7f9af76 (127.28.213.131:34259)
I20260808 17:51:06.512390 13030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3375f6a1f6374a588b734324c04ac277" candidate_uuid: "14b566bbb54449349c639977d120703d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "696f8a428d234b2b9af31896bc4734a1"
I20260808 17:51:06.512430 13429 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3375f6a1f6374a588b734324c04ac277" candidate_uuid: "14b566bbb54449349c639977d120703d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca53e5f5583348099218fb2ab7f9af76"
I20260808 17:51:06.512475 13030 raft_consensus.cc:3037] T 3375f6a1f6374a588b734324c04ac277 P 696f8a428d234b2b9af31896bc4734a1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:51:06.512491 13429 raft_consensus.cc:3037] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:51:06.513134 13429 raft_consensus.cc:2454] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14b566bbb54449349c639977d120703d in term 1.
I20260808 17:51:06.513306 13138 leader_election.cc:302] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14b566bbb54449349c639977d120703d, ca53e5f5583348099218fb2ab7f9af76; no voters:
I20260808 17:51:06.513322 13030 raft_consensus.cc:2454] T 3375f6a1f6374a588b734324c04ac277 P 696f8a428d234b2b9af31896bc4734a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14b566bbb54449349c639977d120703d in term 1.
I20260808 17:51:06.513401 13528 raft_consensus.cc:2781] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:51:06.513550 13528 raft_consensus.cc:686] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [term 1 LEADER]: Becoming Leader. State: Replica: 14b566bbb54449349c639977d120703d, State: Running, Role: LEADER
I20260808 17:51:06.513635 13528 consensus_queue.cc:237] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14b566bbb54449349c639977d120703d" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45445 } } peers { permanent_uuid: "696f8a428d234b2b9af31896bc4734a1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 39303 } } peers { permanent_uuid: "ca53e5f5583348099218fb2ab7f9af76" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34259 } }
I20260808 17:51:06.514420 12813 catalog_manager.cc:5495] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d reported cstate change: term changed from 0 to 1, leader changed from <none> to 14b566bbb54449349c639977d120703d (127.28.213.130). New cstate: current_term: 1 leader_uuid: "14b566bbb54449349c639977d120703d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14b566bbb54449349c639977d120703d" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 45445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "696f8a428d234b2b9af31896bc4734a1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 39303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca53e5f5583348099218fb2ab7f9af76" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34259 } health_report { overall_health: UNKNOWN } } }
I20260808 17:51:06.543537 13509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:06.541393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45124 (local address 127.28.213.130:45445)
0808 17:51:06.541453 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:06.541455 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:06.541465 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:51:06.541518 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:06.541518 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:06.541533 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:06.541589 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:51:06.541687 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.542148 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.542835 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:06.543034 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:06.543079 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:06.543184 (+ 105us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:51:06.543274 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:51:06.543347 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:06.543431 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 17:51:06.543450 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 17:51:06.545153 13429 raft_consensus.cc:1261] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76 [term 1 FOLLOWER]: Refusing update from remote peer 14b566bbb54449349c639977d120703d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:51:06.545158 13030 raft_consensus.cc:1261] T 3375f6a1f6374a588b734324c04ac277 P 696f8a428d234b2b9af31896bc4734a1 [term 1 FOLLOWER]: Refusing update from remote peer 14b566bbb54449349c639977d120703d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:51:06.545493 13531 consensus_queue.cc:1035] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca53e5f5583348099218fb2ab7f9af76" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:51:06.545619 13528 consensus_queue.cc:1035] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [LEADER]: Connected to new peer: Peer: permanent_uuid: "696f8a428d234b2b9af31896bc4734a1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 39303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:51:06.548277 13540 mvcc.cc:205] Tried to move back new op lower bound from 7316322166966571008 to 7316322166840369152. Current Snapshot: MvccSnapshot[applied={T|T < 7316322166966571008}]
I20260808 17:51:06.549830 12813 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46466:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:51:06.549914 12813 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46466:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:51:06.550598 12813 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 89df69a6db5b44a691cbd0133859821f: Sending DeleteTablet for 3 replicas of tablet 3375f6a1f6374a588b734324c04ac277
I20260808 17:51:06.550940 13200 tablet_service.cc:1514] Processing DeleteTablet for tablet 3375f6a1f6374a588b734324c04ac277 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:51:06 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:45122
I20260808 17:51:06.550936 13401 tablet_service.cc:1514] Processing DeleteTablet for tablet 3375f6a1f6374a588b734324c04ac277 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:51:06 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:41886
I20260808 17:51:06.551155 13002 tablet_service.cc:1514] Processing DeleteTablet for tablet 3375f6a1f6374a588b734324c04ac277 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:51:06 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:42768
I20260808 17:51:06.551210 13548 tablet_replica.cc:330] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76: stopping tablet replica
I20260808 17:51:06.551313 13548 raft_consensus.cc:2229] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:51:06.551429 13548 raft_consensus.cc:2258] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:51:06.551437 13551 tablet_replica.cc:330] T 3375f6a1f6374a588b734324c04ac277 P 696f8a428d234b2b9af31896bc4734a1: stopping tablet replica
I20260808 17:51:06.551546 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 12903
I20260808 17:51:06.551575 13550 tablet_replica.cc:330] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d: stopping tablet replica
I20260808 17:51:06.551651 13550 raft_consensus.cc:2229] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:51:06.551659 13551 raft_consensus.cc:2229] T 3375f6a1f6374a588b734324c04ac277 P 696f8a428d234b2b9af31896bc4734a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:51:06.551734 13550 raft_consensus.cc:2258] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:51:06.551865 13551 raft_consensus.cc:2258] T 3375f6a1f6374a588b734324c04ac277 P 696f8a428d234b2b9af31896bc4734a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:51:06.559026 13550 ts_tablet_manager.cc:1905] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:51:06.560720 13550 ts_tablet_manager.cc:1918] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:51:06.560798 13550 log.cc:1196] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/3375f6a1f6374a588b734324c04ac277
I20260808 17:51:06.561059 13550 ts_tablet_manager.cc:1939] T 3375f6a1f6374a588b734324c04ac277 P 14b566bbb54449349c639977d120703d: Deleting consensus metadata
I20260808 17:51:06.561509 12791 catalog_manager.cc:4841] TS 14b566bbb54449349c639977d120703d (127.28.213.130:45445): tablet 3375f6a1f6374a588b734324c04ac277 (table test-table [id=6fa5954ecc564982a7955aeeda43fcba]) successfully deleted
W20260808 17:51:06.565056 12787 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.213.129:39303 (error 108)
I20260808 17:51:06.565475 13548 ts_tablet_manager.cc:1905] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:51:06.565507 13506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:06.565386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:39303 (local address 127.0.0.1:42770)
0808 17:51:06.565436 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:06.565474 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.129:39303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 17:51:06.565608 12787 catalog_manager.cc:4584] TS 696f8a428d234b2b9af31896bc4734a1 (127.28.213.129:39303): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3375f6a1f6374a588b734324c04ac277: Network error: Client connection negotiation failed: client connection to 127.28.213.129:39303: connect: Connection refused (error 111)
I20260808 17:51:06.565913 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 13115
I20260808 17:51:06.568146 13548 ts_tablet_manager.cc:1918] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:51:06.568218 13548 log.cc:1196] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/3375f6a1f6374a588b734324c04ac277
I20260808 17:51:06.568480 13548 ts_tablet_manager.cc:1939] T 3375f6a1f6374a588b734324c04ac277 P ca53e5f5583348099218fb2ab7f9af76: Deleting consensus metadata
I20260808 17:51:06.568845 12787 catalog_manager.cc:4841] TS ca53e5f5583348099218fb2ab7f9af76 (127.28.213.131:34259): tablet 3375f6a1f6374a588b734324c04ac277 (table test-table [id=6fa5954ecc564982a7955aeeda43fcba]) successfully deleted
I20260808 17:51:06.573611 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 13306
I20260808 17:51:06.581585 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 12757
2026-08-08T17:51:06Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2066 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:51:06 dist-test-slave-bndk krb5kdc[13558](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:51:06 dist-test-slave-bndk krb5kdc[13558](info): set up 2 sockets
Aug 08 17:51:06 dist-test-slave-bndk krb5kdc[13558](info): commencing operation
krb5kdc: starting...
W20260808 17:51:07.711001 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:51:07 dist-test-slave-bndk krb5kdc[13558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:51:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:51:07Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.28.213.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.28.213.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.28.213.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/rangeradmin_127.28.213.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.28.213.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/rangeradmin_127.28.213.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.28.213.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.28.213.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.28.213.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/rangerlookup_127.28.213.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.28.213.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/rangerlookup_127.28.213.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.28.213.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.28.213.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.28.213.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/HTTP_127.28.213.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.28.213.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/HTTP_127.28.213.148@KRBTEST.COM.keytab.
I20260808 17:51:07.859117 29526 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskxAQlY3/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/postgres -l logfile start
2026-08-08 17:51:09.998 UTC [13592] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 17:51:09.998 UTC [13592] LOG: listening on IPv4 address "127.28.213.148", port 60413
2026-08-08 17:51:10.001 UTC [13592] LOG: listening on Unix socket "/tmp/.s.PGSQL.60413"
2026-08-08 17:51:10.020 UTC [13595] LOG: database system was shut down at 2026-08-08 17:51:08 UTC
2026-08-08 17:51:10.023 UTC [13592] LOG: database system is ready to accept connections
I20260808 17:51:11.060814 29526 mini_postgres.cc:96] Postgres bound to 60413
2026-08-08 17:51:11.067 UTC [13607] FATAL: database "slave" does not exist
127.28.213.148:60413 - accepting connections
I20260808 17:51:11.068331 29526 mini_ranger.cc:161] Starting Ranger...
I20260808 17:51:11.082808 29526 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 17:51:11.450950 29526 mini_ranger.cc:87] Created ranger Postgres database
I20260808 17:51:11.451032 29526 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ranger-admin
2026-08-08 17:51:11,737 [I] DB FLAVOR :POSTGRES
2026-08-08 17:51:11,737 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 17:51:11,737 [I] Checking connection..
2026-08-08 17:51:11,737 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 17:51:11,987 [I] Checking connection passed.
2026-08-08 17:51:11,987 [I] --------- Verifying version history table ---------
2026-08-08 17:51:11,987 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 17:51:12,238 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 17:51:12,238 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 17:51:12,462 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 17:51:12,462 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 17:51:12,462 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 17:51:12.706 UTC [13702] WARNING: there is no transaction in progress
2026-08-08 17:51:12,712 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 17:51:12,712 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 17:51:12,961 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 17:51:12,962 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 17:51:12,962 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 17:51:13,191 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 17:51:13,423 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-bndk.c.gcp-upstream.internal','N') ;"
2026-08-08 17:51:13,644 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 17:51:13,897 [I] Table x_portal_user does not exist in database ranger
2026-08-08 17:51:13,898 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 17:51:14,137 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 17:51:14,138 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 17:51:14,396 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 17:51:14,624 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 17:51:14,624 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 17:51:15.454 UTC [13861] WARNING: there is no transaction in progress
2026-08-08 17:51:15.468 UTC [13861] WARNING: there is no transaction in progress
2026-08-08 17:51:15.482 UTC [13861] WARNING: there is no transaction in progress
2026-08-08 17:51:15.495 UTC [13861] WARNING: there is no transaction in progress
2026-08-08 17:51:15.508 UTC [13861] WARNING: there is no transaction in progress
2026-08-08 17:51:15.526 UTC [13861] WARNING: there is no transaction in progress
2026-08-08 17:51:15.573 UTC [13861] WARNING: there is no transaction in progress
2026-08-08 17:51:15.579 UTC [13861] WARNING: there is no transaction in progress
2026-08-08 17:51:15.591 UTC [13861] WARNING: there is no transaction in progress
2026-08-08 17:51:15.600 UTC [13861] WARNING: there is no transaction in progress
2026-08-08 17:51:15.608 UTC [13861] WARNING: there is no transaction in progress
2026-08-08 17:51:15.621 UTC [13861] WARNING: there is no transaction in progress
2026-08-08 17:51:15.629 UTC [13861] WARNING: there is no transaction in progress
2026-08-08 17:51:15.634 UTC [13861] WARNING: there is no transaction in progress
2026-08-08 17:51:15.639 UTC [13861] WARNING: there is no transaction in progress
2026-08-08 17:51:15.644 UTC [13861] WARNING: there is no transaction in progress
2026-08-08 17:51:16,141 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 17:51:16,141 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 17:51:16,385 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 17:51:16,386 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 17:51:16,613 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 17:51:16,613 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 17:51:16,864 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 17:51:16,864 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 17:51:17,084 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 17:51:17,336 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-bndk.c.gcp-upstream.internal';"
2026-08-08 17:51:17,574 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 17:51:17,574 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 17:51:17,801 [I] DB_PATCHES have already been applied
I20260808 17:51:17.807192 29526 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ranger-admin:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskxAQlY3/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 17:51:17.807250 29526 mini_ranger.cc:193] Using host: 127.28.213.148
I20260808 17:51:17.811007 29526 mini_ranger.cc:227] Ranger admin URL: http://127.28.213.148:46431
Aug 08, 2026 5:51:18 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:51:18 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:51:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 5:51:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 5:51:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 5:51:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 5:51:18 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 17:51:19.009435 29526 mini_ranger.cc:160] Time spent starting Ranger: real 7.941s user 0.000s sys 0.009s
Aug 08, 2026 5:51:39 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 5:51:39 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 5:51:39 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 5:51:39 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 5:51:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 5:51:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 5:51:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 5:51:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 5:51:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 5:51:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 5:51:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 5:51:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 5:51:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 5:51:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 5:51:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 5:51:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 5:51:39 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 5:51:40 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 17:51:41.261252 29526 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.28.213.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.28.213.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.28.213.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/rangerkms_127.28.213.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.28.213.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/rangerkms_127.28.213.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.28.213.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.28.213.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.28.213.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/HTTP_127.28.213.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.28.213.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/HTTP_127.28.213.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 17:51:41 dist-test-slave-bndk krb5kdc[13558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211501, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 17:51:41.339128 29526 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 17:51:41.351783 29526 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 17:51:42.099789 29526 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 17:51:42.099869 29526 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ranger-kms
I20260808 17:51:42.099884 29526 mini_ranger_kms.cc:227] Using postgres at 127.28.213.148:60413
2026-08-08 17:51:42,730 [I] DB FLAVOR :POSTGRES
2026-08-08 17:51:42,730 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 17:51:42,730 [I] Checking connection
2026-08-08 17:51:42,730 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 17:51:43,036 [I] connection success
2026-08-08 17:51:43,036 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 17:51:43,036 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 17:51:43,036 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 17:51:43,283 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 17:51:43,283 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 17:51:43,284 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 17:51:43,284 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:60413/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 17:51:43,541 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 17:51:44.008262 29526 mini_ranger_kms.cc:310] Created kms service
I20260808 17:51:44.185379 29526 mini_ranger_kms.cc:326] Created kudu user
I20260808 17:51:44.229475 29526 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 17:51:44 dist-test-slave-bndk krb5kdc[13558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211501, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.28.213.148@KRBTEST.COM
I20260808 17:51:44.643038 29526 mini_ranger_kms.cc:384] Added ranger policy
I20260808 17:51:44.643157 29526 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ranger-kms:/tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 17:51:44.643177 29526 mini_ranger_kms.cc:240] Using host: 127.28.213.148
I20260808 17:51:44.647365 29526 mini_ranger_kms.cc:276] Ranger KMS PID: 14117
I20260808 17:51:44.647492 29526 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.28.213.148:36685
Aug 08, 2026 5:51:46 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:51:46 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:51:46 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 5:51:46 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 5:51:46 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 5:51:46 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260808 17:51:47.119910 29526 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.781s user 0.000s sys 0.596s
I20260808 17:51:47.120008 29526 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 17:51:47.120098 29526 mini_ranger_kms.cc:401] 127.28.213.148:36685/kms/v1/keys
Aug 08 17:51:47 dist-test-slave-bndk krb5kdc[13558](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786211507, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.28.213.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 17:51:47 dist-test-slave-bndk krb5kdc[13558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211507, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.28.213.148@KRBTEST.COM for HTTP/127.28.213.148@KRBTEST.COM
Aug 08 17:51:48 dist-test-slave-bndk krb5kdc[13558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211507, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.28.213.148@KRBTEST.COM for HTTP/127.28.213.148@KRBTEST.COM
Aug 08 17:51:50 dist-test-slave-bndk krb5kdc[13558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211510, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:51:50.497859 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:39843
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:39843
--ranger_config_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.213.148:36685/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:51:50.598634 14187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:51:50.598834 14187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:51:50.598862 14187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:51:50.600067 14187 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:51:50.600111 14187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:51:50.600129 14187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:51:50.600145 14187 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:51:50.600159 14187 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:51:50.601703 14187 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/master-0/wal
--ranger_kms_url=127.28.213.148:36685/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:39843
--ranger_config_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:39843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14187
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:51:50.601943 14187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:51:50.602174 14187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:51:50.607337 14192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:50.607399 14193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:50.607378 14187 server_base.cc:1034] running on GCE node
W20260808 17:51:50.607583 14196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:50.607792 14187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:51:50.608069 14187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:51:50.609239 14187 hybrid_clock.cc:648] HybridClock initialized: now 1786211510609208 us; error 27 us; skew 500 ppm
Aug 08 17:51:50 dist-test-slave-bndk krb5kdc[13558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211510, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:51:50.614941 14187 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:51:50.615357 14187 webserver.cc:460] Webserver started at http://127.28.213.190:37217/ using document root <none> and password file <none>
I20260808 17:51:50.615548 14187 fs_manager.cc:359] Metadata directory not provided
I20260808 17:51:50.615587 14187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:51:50.615712 14187 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 17:51:50 dist-test-slave-bndk krb5kdc[13558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211510, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for HTTP/127.28.213.148@KRBTEST.COM
I20260808 17:51:50.669852 14187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "884f5e35d50e4948800652fecef2d55c"
format_stamp: "Formatted at 2026-08-08 17:51:50 on dist-test-slave-bndk"
server_key: "ddb7d273ccdf1d75bfc513a81c5ba83c"
server_key_iv: "8f8a2b1971c9796744a1a18f80ebc067"
server_key_version: "kuduclusterkey@0"
I20260808 17:51:50.670357 14187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "884f5e35d50e4948800652fecef2d55c"
format_stamp: "Formatted at 2026-08-08 17:51:50 on dist-test-slave-bndk"
server_key: "ddb7d273ccdf1d75bfc513a81c5ba83c"
server_key_iv: "8f8a2b1971c9796744a1a18f80ebc067"
server_key_version: "kuduclusterkey@0"
I20260808 17:51:50.672147 14187 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 17:51:50.683187 14207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:50.683465 14187 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:51:50.683569 14187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "884f5e35d50e4948800652fecef2d55c"
format_stamp: "Formatted at 2026-08-08 17:51:50 on dist-test-slave-bndk"
server_key: "ddb7d273ccdf1d75bfc513a81c5ba83c"
server_key_iv: "8f8a2b1971c9796744a1a18f80ebc067"
server_key_version: "kuduclusterkey@0"
I20260808 17:51:50.683647 14187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:51:50.714843 14187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:51:50.716758 14187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:51:50.716992 14187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:51:50.727087 14187 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:39843
I20260808 17:51:50.727162 14280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:39843 every 8 connection(s)
I20260808 17:51:50.727672 14187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:51:50.728729 14281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:51:50.732285 14281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c: Bootstrap starting.
I20260808 17:51:50.733335 14281 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c: Neither blocks nor log segments found. Creating new log.
I20260808 17:51:50.733718 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 14187
I20260808 17:51:50.733824 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:51:50.734041 29526 external_mini_cluster.cc:1428] Setting key f79df859e6f5375f95ef398236718216
I20260808 17:51:50.734091 14281 log.cc:824] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c: Log is configured to *not* fsync() on all Append() calls
I20260808 17:51:50.735086 14281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c: No bootstrap required, opened a new log
I20260808 17:51:50.737982 14281 raft_consensus.cc:348] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "884f5e35d50e4948800652fecef2d55c" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39843 } }
I20260808 17:51:50.738183 14281 raft_consensus.cc:374] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:51:50.738243 14281 raft_consensus.cc:729] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 884f5e35d50e4948800652fecef2d55c, State: Initialized, Role: FOLLOWER
I20260808 17:51:50.738407 14281 consensus_queue.cc:260] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "884f5e35d50e4948800652fecef2d55c" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39843 } }
I20260808 17:51:50.738528 14281 raft_consensus.cc:388] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:51:50.738575 14281 raft_consensus.cc:482] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:51:50.738633 14281 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:51:50.739413 14281 raft_consensus.cc:504] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "884f5e35d50e4948800652fecef2d55c" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39843 } }
I20260808 17:51:50.739544 14281 leader_election.cc:302] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 884f5e35d50e4948800652fecef2d55c; no voters:
I20260808 17:51:50.739722 14281 leader_election.cc:288] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:51:50.740016 14281 sys_catalog.cc:564] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:51:50.741151 14295 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:51:50.741456 14295 raft_consensus.cc:686] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c [term 1 LEADER]: Becoming Leader. State: Replica: 884f5e35d50e4948800652fecef2d55c, State: Running, Role: LEADER
I20260808 17:51:50.741618 14295 consensus_queue.cc:237] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "884f5e35d50e4948800652fecef2d55c" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39843 } }
I20260808 17:51:50.742228 14295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "884f5e35d50e4948800652fecef2d55c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "884f5e35d50e4948800652fecef2d55c" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39843 } } }
I20260808 17:51:50.742377 14295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c [sys.catalog]: This master's current role is: LEADER
I20260808 17:51:50.742491 14281 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 17:51:50.742640 14295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 884f5e35d50e4948800652fecef2d55c. Latest consensus state: current_term: 1 leader_uuid: "884f5e35d50e4948800652fecef2d55c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "884f5e35d50e4948800652fecef2d55c" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39843 } } }
I20260808 17:51:50.742767 14295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c [sys.catalog]: This master's current role is: LEADER
I20260808 17:51:50.743009 14313 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 08 17:51:50 dist-test-slave-bndk krb5kdc[13558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211510, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:51:50.743590 14313 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:51:50.751583 14292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:50.734568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54058 (local address 127.28.213.190:39843)
0808 17:51:50.734823 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:50.734832 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:50.734883 (+ 51us) server_negotiation.cc:407] Connection header received
0808 17:51:50.735539 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:50.735548 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:50.735601 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:50.735727 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:50.736398 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:50.737949 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:50.739439 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:50.740470 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:50.740584 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:50.743786 (+ 3202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:51:50.743790 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:51:50.743790 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:51:50.743802 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:51:50.745919 (+ 2117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:50.746296 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:50.746299 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:50.746300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:50.746402 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:50.746602 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:50.746603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:50.746604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:50.749087 (+ 2483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:51:50.750083 (+ 996us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:50.750264 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 17:51:50.751121 (+ 857us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":71,"threads_started":1}
I20260808 17:51:50.753136 14313 catalog_manager.cc:1347] Generated new cluster ID: 2473640ca7d44412804b8d24aa2e0b02
I20260808 17:51:50.753194 14313 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:51:50.777700 14313 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:51:50.778667 14313 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:51:50.791493 14313 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c: Generated new TSK 0
I20260808 17:51:50.791751 14313 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
I20260808 17:51:51.633771 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.213.148:36685/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:39843
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:51:51.767655 14350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:51:51.767916 14350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:51:51.767958 14350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:51:51.769604 14350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:51:51.769657 14350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:51:51.769693 14350 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:51:51.771778 14350 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.28.213.148:36685/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:39843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:51:51.772001 14350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:51:51.772266 14350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:51:51.777271 14360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:51.777298 14359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:51.777408 14350 server_base.cc:1034] running on GCE node
W20260808 17:51:51.777580 14363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:51.777746 14350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:51:51.777976 14350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:51:51.779127 14350 hybrid_clock.cc:648] HybridClock initialized: now 1786211511779122 us; error 31 us; skew 500 ppm
Aug 08 17:51:51 dist-test-slave-bndk krb5kdc[13558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211511, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:51:51.781548 14350 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:51:51.781955 14350 webserver.cc:460] Webserver started at http://127.28.213.129:43243/ using document root <none> and password file <none>
I20260808 17:51:51.782168 14350 fs_manager.cc:359] Metadata directory not provided
I20260808 17:51:51.782210 14350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:51:51.782317 14350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 17:51:51 dist-test-slave-bndk krb5kdc[13558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211511, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for HTTP/127.28.213.148@KRBTEST.COM
I20260808 17:51:51.800741 14350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "4b1e59e889db4ce1addd49b82b3e351d"
format_stamp: "Formatted at 2026-08-08 17:51:51 on dist-test-slave-bndk"
server_key: "bd86e34dbe51b25e321e005db6b58286"
server_key_iv: "76217f7693a645d58784e9798f6aab9c"
server_key_version: "kuduclusterkey@0"
I20260808 17:51:51.801471 14350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "4b1e59e889db4ce1addd49b82b3e351d"
format_stamp: "Formatted at 2026-08-08 17:51:51 on dist-test-slave-bndk"
server_key: "bd86e34dbe51b25e321e005db6b58286"
server_key_iv: "76217f7693a645d58784e9798f6aab9c"
server_key_version: "kuduclusterkey@0"
I20260808 17:51:51.804083 14350 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 17:51:51.822077 14374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:51.822273 14350 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 17:51:51.822358 14350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "4b1e59e889db4ce1addd49b82b3e351d"
format_stamp: "Formatted at 2026-08-08 17:51:51 on dist-test-slave-bndk"
server_key: "bd86e34dbe51b25e321e005db6b58286"
server_key_iv: "76217f7693a645d58784e9798f6aab9c"
server_key_version: "kuduclusterkey@0"
I20260808 17:51:51.822443 14350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:51:51.855628 14350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:51:51.859007 14350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:51:51.859229 14350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:51:51.859540 14350 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:51:51.859977 14350 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:51:51.860072 14350 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:51.860172 14350 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:51:51.860240 14350 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:51.866890 14350 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:44927
I20260808 17:51:51.867388 14350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:51:51.869310 14544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:44927 every 8 connection(s)
I20260808 17:51:51.872128 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 14350
I20260808 17:51:51.872239 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:51:51.872447 29526 external_mini_cluster.cc:1428] Setting key 97acc967947b987418342a779c9fa8ac
Aug 08 17:51:51 dist-test-slave-bndk krb5kdc[13558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211511, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:51:51.880837 14548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:51.870041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:39843 (local address 127.28.213.129:56869)
0808 17:51:51.870236 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:51.870288 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:51.870935 (+ 647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:51.871423 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:51.871427 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:51.871676 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:51.871967 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:51.871974 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:51.873046 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:51.873047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:51.874367 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:51.874370 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:51.874921 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:51.874922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:51.875065 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:51.875632 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:51:51.875642 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:51.877294 (+ 1652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:51:51.879254 (+ 1960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:51:51.879261 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:51:51.879263 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:51:51.879541 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:51:51.879755 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:51:51.879755 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:51:51.879756 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:51:51.879890 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:51:51.880176 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:51:51.880182 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:51:51.880340 (+ 158us) client_negotiation.cc:769] Sending connection context
0808 17:51:51.880453 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 17:51:51.880603 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":100,"threads_started":1}
I20260808 17:51:51.881392 14549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:51.870380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:56869 (local address 127.28.213.190:39843)
0808 17:51:51.871177 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:51.871179 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:51.871191 (+ 12us) server_negotiation.cc:407] Connection header received
0808 17:51:51.871219 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:51.871220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:51.871233 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:51.871336 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:51.872084 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:51.872941 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:51.874465 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:51.874785 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:51.874854 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:51.877395 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:51:51.877397 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:51:51.877397 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:51:51.877405 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:51:51.879162 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:51.879624 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:51.879626 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:51.879626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:51.879692 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:51.879959 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:51.879960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:51.879960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:51.880093 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:51:51.880150 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:51.881189 (+ 1039us) server_negotiation.cc:299] Negotiation successful
0808 17:51:51.881297 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":769,"thread_start_us":61,"threads_started":1}
I20260808 17:51:51.882062 14545 heartbeater.cc:347] Connected to a master server at 127.28.213.190:39843
I20260808 17:51:51.882164 14545 heartbeater.cc:464] Registering TS with master...
I20260808 17:51:51.882339 14545 heartbeater.cc:511] Master 127.28.213.190:39843 requested a full tablet report, sending...
I20260808 17:51:51.882858 14233 ts_manager.cc:194] Registered new tserver with Master: 4b1e59e889db4ce1addd49b82b3e351d (127.28.213.129:44927)
I20260808 17:51:51.883430 14233 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:56869
WARNING: no policy specified for kudu/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
I20260808 17:51:51.902161 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.213.148:36685/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:39843
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:51:52.019990 14553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:51:52.020249 14553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:51:52.020298 14553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:51:52.021991 14553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:51:52.022115 14553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:51:52.022207 14553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:51:52.024466 14553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.28.213.148:36685/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:39843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:51:52.024704 14553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:51:52.025014 14553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 08 17:51:52 dist-test-slave-bndk krb5kdc[13558](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786211512, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 17:51:52.031129 14569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:52.031383 14563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:52.031651 14564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:52.031816 14553 server_base.cc:1034] running on GCE node
I20260808 17:51:52.032140 14553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:51:52.032421 14553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:51:52.033669 14553 hybrid_clock.cc:648] HybridClock initialized: now 1786211512033640 us; error 38 us; skew 500 ppm
Aug 08 17:51:52 dist-test-slave-bndk krb5kdc[13558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211512, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:51:52.036903 14553 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:51:52.037401 14553 webserver.cc:460] Webserver started at http://127.28.213.130:38655/ using document root <none> and password file <none>
I20260808 17:51:52.037639 14553 fs_manager.cc:359] Metadata directory not provided
I20260808 17:51:52.037688 14553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:51:52.037806 14553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 17:51:52 dist-test-slave-bndk krb5kdc[13558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211512, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for HTTP/127.28.213.148@KRBTEST.COM
I20260808 17:51:52.063783 14553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "b34d9a6147824405bdc014d24c8f103b"
format_stamp: "Formatted at 2026-08-08 17:51:52 on dist-test-slave-bndk"
server_key: "8aad85cbdd92176c2dbe8dad43df7166"
server_key_iv: "d15ff41a4f4a83496933214d6ec82c5e"
server_key_version: "kuduclusterkey@0"
I20260808 17:51:52.064232 14553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "b34d9a6147824405bdc014d24c8f103b"
format_stamp: "Formatted at 2026-08-08 17:51:52 on dist-test-slave-bndk"
server_key: "8aad85cbdd92176c2dbe8dad43df7166"
server_key_iv: "d15ff41a4f4a83496933214d6ec82c5e"
server_key_version: "kuduclusterkey@0"
I20260808 17:51:52.066139 14553 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 17:51:52.078044 14579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:52.078215 14553 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:51:52.078346 14553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "b34d9a6147824405bdc014d24c8f103b"
format_stamp: "Formatted at 2026-08-08 17:51:52 on dist-test-slave-bndk"
server_key: "8aad85cbdd92176c2dbe8dad43df7166"
server_key_iv: "d15ff41a4f4a83496933214d6ec82c5e"
server_key_version: "kuduclusterkey@0"
I20260808 17:51:52.078416 14553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:51:52.087890 14553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:51:52.089901 14553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:51:52.090082 14553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:51:52.090358 14553 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:51:52.090746 14553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:51:52.090834 14553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:52.090893 14553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:51:52.090936 14553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:52.099654 14553 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:37107
I20260808 17:51:52.099751 14764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:37107 every 8 connection(s)
I20260808 17:51:52.100016 14553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
Aug 08 17:51:52 dist-test-slave-bndk krb5kdc[13558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211512, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:51:52.107571 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 14553
I20260808 17:51:52.107679 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:51:52.107894 29526 external_mini_cluster.cc:1428] Setting key a087afe1f7b83d460794a78769f55b4c
I20260808 17:51:52.108886 14549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.100773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:58659 (local address 127.28.213.190:39843)
0808 17:51:52.100826 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:52.100828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:52.101046 (+ 218us) server_negotiation.cc:407] Connection header received
0808 17:51:52.101668 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:52.101670 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:52.101689 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:52.101742 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:52.102293 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.102791 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.103880 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.104096 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.104153 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.106054 (+ 1901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:51:52.106056 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:51:52.106056 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:51:52.106062 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:51:52.107313 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:52.107781 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:52.107783 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:52.107783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:52.107848 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:52.108129 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:52.108131 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:52.108131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:52.108264 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:51:52.108317 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:52.108678 (+ 361us) server_negotiation.cc:299] Negotiation successful
0808 17:51:52.108773 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:51:52.110251 14769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.100751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:39843 (local address 127.28.213.130:58659)
0808 17:51:52.100915 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:52.100955 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:52.101509 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:52.101827 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:52.101832 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:52.102007 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:52.102192 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:52.102197 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.102874 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.102875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:52.103794 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:52.103797 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.104167 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.104169 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:52.104294 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.104720 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:51:52.104728 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:52.105967 (+ 1239us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:51:52.107394 (+ 1427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:51:52.107402 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:51:52.107404 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:51:52.107689 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:51:52.107919 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:51:52.107920 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:51:52.107920 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:51:52.108050 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:51:52.108363 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:51:52.108370 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:51:52.108528 (+ 158us) client_negotiation.cc:769] Sending connection context
0808 17:51:52.109870 (+ 1342us) client_negotiation.cc:240] Negotiation successful
0808 17:51:52.110029 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":97,"threads_started":1}
I20260808 17:51:52.113273 14765 heartbeater.cc:347] Connected to a master server at 127.28.213.190:39843
I20260808 17:51:52.113425 14765 heartbeater.cc:464] Registering TS with master...
I20260808 17:51:52.113621 14765 heartbeater.cc:511] Master 127.28.213.190:39843 requested a full tablet report, sending...
I20260808 17:51:52.114023 14233 ts_manager.cc:194] Registered new tserver with Master: b34d9a6147824405bdc014d24c8f103b (127.28.213.130:37107)
I20260808 17:51:52.114387 14233 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:58659
WARNING: no policy specified for kudu/127.28.213.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
I20260808 17:51:52.136325 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.213.148:36685/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:39843
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:51:52.242758 14772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:51:52.242969 14772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:51:52.243000 14772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:51:52.244202 14772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:51:52.244246 14772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:51:52.244282 14772 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:51:52.245894 14772 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.28.213.148:36685/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:39843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:51:52.246181 14772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:51:52.246426 14772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:51:52.252053 14781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:52.252269 14778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:51:52.252018 14785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:51:52.252715 14772 server_base.cc:1034] running on GCE node
I20260808 17:51:52.252907 14772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:51:52.253122 14772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:51:52.254276 14772 hybrid_clock.cc:648] HybridClock initialized: now 1786211512254252 us; error 37 us; skew 500 ppm
Aug 08 17:51:52 dist-test-slave-bndk krb5kdc[13558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211512, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:51:52.256951 14772 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:51:52.257403 14772 webserver.cc:460] Webserver started at http://127.28.213.131:37587/ using document root <none> and password file <none>
I20260808 17:51:52.257611 14772 fs_manager.cc:359] Metadata directory not provided
I20260808 17:51:52.257656 14772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:51:52.257786 14772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 17:51:52 dist-test-slave-bndk krb5kdc[13558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211512, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for HTTP/127.28.213.148@KRBTEST.COM
I20260808 17:51:52.270488 14772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "55f6bdbeb61644e58ec134b61f130bfc"
format_stamp: "Formatted at 2026-08-08 17:51:52 on dist-test-slave-bndk"
server_key: "ed11e1edaa7e3ddc742fc99a03d5ba77"
server_key_iv: "4c4eedc882b7c679071a19c86ef1609c"
server_key_version: "kuduclusterkey@0"
I20260808 17:51:52.270982 14772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "55f6bdbeb61644e58ec134b61f130bfc"
format_stamp: "Formatted at 2026-08-08 17:51:52 on dist-test-slave-bndk"
server_key: "ed11e1edaa7e3ddc742fc99a03d5ba77"
server_key_iv: "4c4eedc882b7c679071a19c86ef1609c"
server_key_version: "kuduclusterkey@0"
I20260808 17:51:52.277766 14772 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.000s
I20260808 17:51:52.294435 14796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:52.294677 14772 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260808 17:51:52.294768 14772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "55f6bdbeb61644e58ec134b61f130bfc"
format_stamp: "Formatted at 2026-08-08 17:51:52 on dist-test-slave-bndk"
server_key: "ed11e1edaa7e3ddc742fc99a03d5ba77"
server_key_iv: "4c4eedc882b7c679071a19c86ef1609c"
server_key_version: "kuduclusterkey@0"
I20260808 17:51:52.294854 14772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:51:52.312937 14772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:51:52.315207 14772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:51:52.315348 14772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:51:52.315685 14772 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:51:52.316094 14772 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:51:52.316134 14772 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:52.316164 14772 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:51:52.316187 14772 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:51:52.334507 14772 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:40081
I20260808 17:51:52.335281 14772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:51:52.337724 14955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:40081 every 8 connection(s)
I20260808 17:51:52.343003 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 14772
I20260808 17:51:52.343124 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:51:52.343324 29526 external_mini_cluster.cc:1428] Setting key c73bcbc7805417f65e05e3b029ff905d
Aug 08 17:51:52 dist-test-slave-bndk krb5kdc[13558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211512, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:51:52.347775 14549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.338561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:53195 (local address 127.28.213.190:39843)
0808 17:51:52.338633 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:52.338635 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:52.338942 (+ 307us) server_negotiation.cc:407] Connection header received
0808 17:51:52.339641 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:52.339642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:52.339655 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:52.339705 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:52.340705 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.341382 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.342436 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.342637 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.342691 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.345281 (+ 2590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:51:52.345283 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:51:52.345283 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:51:52.345290 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:51:52.346562 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:52.346917 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:52.346919 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:52.346919 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:52.346976 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:52.347188 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:52.347189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:52.347190 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:52.347300 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:51:52.347356 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:52.347606 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 17:51:52.347689 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 17:51:52.347978 14958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.338541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:39843 (local address 127.28.213.131:53195)
0808 17:51:52.338809 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:52.338854 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:52.339537 (+ 683us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:52.339774 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:52.339778 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:52.340246 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:51:52.340617 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:52.340624 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.341471 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.341472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:52.342355 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:52.342358 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.342703 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.342704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:52.342908 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.343593 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:51:52.343602 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:51:52.345197 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:51:52.346635 (+ 1438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:51:52.346642 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:51:52.346644 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:51:52.346853 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:51:52.347028 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:51:52.347029 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:51:52.347029 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:51:52.347134 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:51:52.347354 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:51:52.347360 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:51:52.347491 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 17:51:52.347578 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 17:51:52.347713 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":156,"threads_started":1}
I20260808 17:51:52.348464 14956 heartbeater.cc:347] Connected to a master server at 127.28.213.190:39843
I20260808 17:51:52.348580 14956 heartbeater.cc:464] Registering TS with master...
I20260808 17:51:52.348781 14956 heartbeater.cc:511] Master 127.28.213.190:39843 requested a full tablet report, sending...
I20260808 17:51:52.349159 14233 ts_manager.cc:194] Registered new tserver with Master: 55f6bdbeb61644e58ec134b61f130bfc (127.28.213.131:40081)
I20260808 17:51:52.349503 14233 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:53195
I20260808 17:51:52.355181 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:51:52.362008 14549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.356453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54066 (local address 127.28.213.190:39843)
0808 17:51:52.356491 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:52.356492 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:52.356651 (+ 159us) server_negotiation.cc:407] Connection header received
0808 17:51:52.356709 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:52.356710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:52.356719 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:52.356762 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:51:52.357332 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.357773 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.358457 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.358651 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.358701 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.359812 (+ 1111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:51:52.359813 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:51:52.359813 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:51:52.359820 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:51:52.361011 (+ 1191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:52.361343 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:52.361344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:52.361344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:52.361399 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:51:52.361558 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:51:52.361559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:51:52.361559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:51:52.361658 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:51:52.361742 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:52.361856 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 17:51:52.361925 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:51:52.363709 14233 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54066:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:51:52.366210 14233 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:51:52.373534 14977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.368887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:44927 (local address 127.0.0.1:52448)
0808 17:51:52.369501 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:52.369542 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:52.369616 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:52.369930 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:52.369933 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:52.369936 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:51:52.369979 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:52.369980 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.371159 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.371159 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:52.372231 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:52.372234 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.373319 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.373319 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:52.373375 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.373386 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 17:51:52.373444 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 17:51:52.373481 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":418,"threads_started":1}
I20260808 17:51:52.373634 14973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.369092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52448 (local address 127.28.213.129:44927)
0808 17:51:52.369437 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:52.369443 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:52.369600 (+ 157us) server_negotiation.cc:407] Connection header received
0808 17:51:52.369740 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:52.369743 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:52.369761 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:52.369825 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:51:52.370052 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.371082 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.372340 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.373173 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.373333 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.373408 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:52.373468 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 17:51:52.373511 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":59,"threads_started":1}
I20260808 17:51:52.374439 14450 tablet_service.cc:1467] Processing CreateTablet for tablet 3cd31a8198884338bd63ead7548bfcd5 (DEFAULT_TABLE table=test-table [id=97b2d73ef94e40e396ffe0bc0e9c8e3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:51:52.374836 14450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cd31a8198884338bd63ead7548bfcd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:51:52.378674 14982 tablet_bootstrap.cc:492] T 3cd31a8198884338bd63ead7548bfcd5 P 4b1e59e889db4ce1addd49b82b3e351d: Bootstrap starting.
I20260808 17:51:52.380026 14982 tablet_bootstrap.cc:654] T 3cd31a8198884338bd63ead7548bfcd5 P 4b1e59e889db4ce1addd49b82b3e351d: Neither blocks nor log segments found. Creating new log.
I20260808 17:51:52.380787 14981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.368887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:40081 (local address 127.0.0.1:33476)
0808 17:51:52.369708 (+ 821us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:52.369718 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:52.369759 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:52.377520 (+ 7761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:52.377521 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:52.377524 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:51:52.377575 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:52.377577 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.378996 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.378997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:52.379685 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:52.379686 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.380581 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.380582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:52.380642 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.380646 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:51:52.380683 (+ 37us) client_negotiation.cc:240] Negotiation successful
0808 17:51:52.380719 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":781,"mutex_wait_us":1,"thread_start_us":554,"threads_started":1}
I20260808 17:51:52.380767 14982 log.cc:824] T 3cd31a8198884338bd63ead7548bfcd5 P 4b1e59e889db4ce1addd49b82b3e351d: Log is configured to *not* fsync() on all Append() calls
I20260808 17:51:52.381162 14976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.369122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33476 (local address 127.28.213.131:40081)
0808 17:51:52.377377 (+ 8255us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:52.377381 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:52.377392 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:51:52.377423 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:52.377424 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:52.377437 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:52.377513 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:51:52.377659 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.378926 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.379821 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.380508 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.380890 (+ 382us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.380969 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:52.380997 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 17:51:52.381034 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8218,"thread_start_us":193,"threads_started":1}
I20260808 17:51:52.381963 14982 tablet_bootstrap.cc:492] T 3cd31a8198884338bd63ead7548bfcd5 P 4b1e59e889db4ce1addd49b82b3e351d: No bootstrap required, opened a new log
I20260808 17:51:52.381901 14857 tablet_service.cc:1467] Processing CreateTablet for tablet 3cd31a8198884338bd63ead7548bfcd5 (DEFAULT_TABLE table=test-table [id=97b2d73ef94e40e396ffe0bc0e9c8e3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:51:52.382087 14982 ts_tablet_manager.cc:1397] T 3cd31a8198884338bd63ead7548bfcd5 P 4b1e59e889db4ce1addd49b82b3e351d: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:51:52.382309 14857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cd31a8198884338bd63ead7548bfcd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:51:52.384912 14982 raft_consensus.cc:348] T 3cd31a8198884338bd63ead7548bfcd5 P 4b1e59e889db4ce1addd49b82b3e351d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e59e889db4ce1addd49b82b3e351d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 44927 } } peers { permanent_uuid: "b34d9a6147824405bdc014d24c8f103b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37107 } } peers { permanent_uuid: "55f6bdbeb61644e58ec134b61f130bfc" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40081 } }
I20260808 17:51:52.385169 14982 raft_consensus.cc:374] T 3cd31a8198884338bd63ead7548bfcd5 P 4b1e59e889db4ce1addd49b82b3e351d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:51:52.385278 14982 raft_consensus.cc:729] T 3cd31a8198884338bd63ead7548bfcd5 P 4b1e59e889db4ce1addd49b82b3e351d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b1e59e889db4ce1addd49b82b3e351d, State: Initialized, Role: FOLLOWER
I20260808 17:51:52.385468 14982 consensus_queue.cc:260] T 3cd31a8198884338bd63ead7548bfcd5 P 4b1e59e889db4ce1addd49b82b3e351d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e59e889db4ce1addd49b82b3e351d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 44927 } } peers { permanent_uuid: "b34d9a6147824405bdc014d24c8f103b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37107 } } peers { permanent_uuid: "55f6bdbeb61644e58ec134b61f130bfc" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40081 } }
I20260808 17:51:52.385802 14982 ts_tablet_manager.cc:1428] T 3cd31a8198884338bd63ead7548bfcd5 P 4b1e59e889db4ce1addd49b82b3e351d: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260808 17:51:52.385962 14545 heartbeater.cc:503] Master 127.28.213.190:39843 was elected leader, sending a full tablet report...
I20260808 17:51:52.386065 14977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.368900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:37107 (local address 127.0.0.1:47328)
0808 17:51:52.373686 (+ 4786us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:52.373695 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:52.373896 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:52.381590 (+ 7694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:52.381591 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:52.381594 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:51:52.381627 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:52.381628 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.383053 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.383054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:52.384555 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:52.384559 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.385827 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.385828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:52.385893 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.385896 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:51:52.385953 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 17:51:52.385993 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4776,"thread_start_us":684,"threads_started":1}
I20260808 17:51:52.386426 14974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.369155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47328 (local address 127.28.213.130:37107)
0808 17:51:52.381334 (+ 12179us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:52.381339 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:52.381351 (+ 12us) server_negotiation.cc:407] Connection header received
0808 17:51:52.381394 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:52.381396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:52.381412 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:52.381499 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:51:52.381713 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.382951 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.384685 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.385605 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.385727 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.385787 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:52.386263 (+ 476us) server_negotiation.cc:299] Negotiation successful
0808 17:51:52.386317 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12125,"thread_start_us":128,"threads_started":1}
I20260808 17:51:52.387073 14654 tablet_service.cc:1467] Processing CreateTablet for tablet 3cd31a8198884338bd63ead7548bfcd5 (DEFAULT_TABLE table=test-table [id=97b2d73ef94e40e396ffe0bc0e9c8e3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:51:52.387415 14654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cd31a8198884338bd63ead7548bfcd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:51:52.391294 14987 tablet_bootstrap.cc:492] T 3cd31a8198884338bd63ead7548bfcd5 P b34d9a6147824405bdc014d24c8f103b: Bootstrap starting.
I20260808 17:51:52.391897 14988 tablet_bootstrap.cc:492] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc: Bootstrap starting.
I20260808 17:51:52.392509 14987 tablet_bootstrap.cc:654] T 3cd31a8198884338bd63ead7548bfcd5 P b34d9a6147824405bdc014d24c8f103b: Neither blocks nor log segments found. Creating new log.
I20260808 17:51:52.393067 14987 log.cc:824] T 3cd31a8198884338bd63ead7548bfcd5 P b34d9a6147824405bdc014d24c8f103b: Log is configured to *not* fsync() on all Append() calls
I20260808 17:51:52.393319 14988 tablet_bootstrap.cc:654] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc: Neither blocks nor log segments found. Creating new log.
I20260808 17:51:52.393898 14987 tablet_bootstrap.cc:492] T 3cd31a8198884338bd63ead7548bfcd5 P b34d9a6147824405bdc014d24c8f103b: No bootstrap required, opened a new log
I20260808 17:51:52.393957 14987 ts_tablet_manager.cc:1397] T 3cd31a8198884338bd63ead7548bfcd5 P b34d9a6147824405bdc014d24c8f103b: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260808 17:51:52.393982 14988 log.cc:824] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc: Log is configured to *not* fsync() on all Append() calls
I20260808 17:51:52.394941 14988 tablet_bootstrap.cc:492] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc: No bootstrap required, opened a new log
I20260808 17:51:52.395022 14988 ts_tablet_manager.cc:1397] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 17:51:52.396916 14987 raft_consensus.cc:348] T 3cd31a8198884338bd63ead7548bfcd5 P b34d9a6147824405bdc014d24c8f103b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e59e889db4ce1addd49b82b3e351d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 44927 } } peers { permanent_uuid: "b34d9a6147824405bdc014d24c8f103b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37107 } } peers { permanent_uuid: "55f6bdbeb61644e58ec134b61f130bfc" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40081 } }
I20260808 17:51:52.397100 14987 raft_consensus.cc:374] T 3cd31a8198884338bd63ead7548bfcd5 P b34d9a6147824405bdc014d24c8f103b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:51:52.397141 14987 raft_consensus.cc:729] T 3cd31a8198884338bd63ead7548bfcd5 P b34d9a6147824405bdc014d24c8f103b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b34d9a6147824405bdc014d24c8f103b, State: Initialized, Role: FOLLOWER
I20260808 17:51:52.397292 14987 consensus_queue.cc:260] T 3cd31a8198884338bd63ead7548bfcd5 P b34d9a6147824405bdc014d24c8f103b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e59e889db4ce1addd49b82b3e351d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 44927 } } peers { permanent_uuid: "b34d9a6147824405bdc014d24c8f103b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37107 } } peers { permanent_uuid: "55f6bdbeb61644e58ec134b61f130bfc" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40081 } }
I20260808 17:51:52.397549 14987 ts_tablet_manager.cc:1428] T 3cd31a8198884338bd63ead7548bfcd5 P b34d9a6147824405bdc014d24c8f103b: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20260808 17:51:52.397617 14765 heartbeater.cc:503] Master 127.28.213.190:39843 was elected leader, sending a full tablet report...
I20260808 17:51:52.398119 14988 raft_consensus.cc:348] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e59e889db4ce1addd49b82b3e351d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 44927 } } peers { permanent_uuid: "b34d9a6147824405bdc014d24c8f103b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37107 } } peers { permanent_uuid: "55f6bdbeb61644e58ec134b61f130bfc" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40081 } }
I20260808 17:51:52.398289 14988 raft_consensus.cc:374] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:51:52.398334 14988 raft_consensus.cc:729] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55f6bdbeb61644e58ec134b61f130bfc, State: Initialized, Role: FOLLOWER
I20260808 17:51:52.398454 14988 consensus_queue.cc:260] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e59e889db4ce1addd49b82b3e351d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 44927 } } peers { permanent_uuid: "b34d9a6147824405bdc014d24c8f103b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37107 } } peers { permanent_uuid: "55f6bdbeb61644e58ec134b61f130bfc" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40081 } }
I20260808 17:51:52.398705 14988 ts_tablet_manager.cc:1428] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260808 17:51:52.398818 14956 heartbeater.cc:503] Master 127.28.213.190:39843 was elected leader, sending a full tablet report...
I20260808 17:51:52.415743 14992 raft_consensus.cc:482] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:51:52.415866 14992 raft_consensus.cc:504] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e59e889db4ce1addd49b82b3e351d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 44927 } } peers { permanent_uuid: "b34d9a6147824405bdc014d24c8f103b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37107 } } peers { permanent_uuid: "55f6bdbeb61644e58ec134b61f130bfc" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40081 } }
I20260808 17:51:52.415844 14985 raft_consensus.cc:482] T 3cd31a8198884338bd63ead7548bfcd5 P 4b1e59e889db4ce1addd49b82b3e351d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:51:52.415992 14985 raft_consensus.cc:504] T 3cd31a8198884338bd63ead7548bfcd5 P 4b1e59e889db4ce1addd49b82b3e351d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e59e889db4ce1addd49b82b3e351d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 44927 } } peers { permanent_uuid: "b34d9a6147824405bdc014d24c8f103b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37107 } } peers { permanent_uuid: "55f6bdbeb61644e58ec134b61f130bfc" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40081 } }
I20260808 17:51:52.416258 14985 leader_election.cc:288] T 3cd31a8198884338bd63ead7548bfcd5 P 4b1e59e889db4ce1addd49b82b3e351d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b34d9a6147824405bdc014d24c8f103b (127.28.213.130:37107), 55f6bdbeb61644e58ec134b61f130bfc (127.28.213.131:40081)
I20260808 17:51:52.416810 14992 leader_election.cc:288] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b1e59e889db4ce1addd49b82b3e351d (127.28.213.129:44927), b34d9a6147824405bdc014d24c8f103b (127.28.213.130:37107)
I20260808 17:51:52.420650 14974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.416620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:36875 (local address 127.28.213.130:37107)
0808 17:51:52.416675 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:52.416677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:52.417048 (+ 371us) server_negotiation.cc:407] Connection header received
0808 17:51:52.417106 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:52.417107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:52.417118 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:52.417174 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:51:52.417557 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.418292 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.419728 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.420268 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.420319 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.420327 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:52.420547 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 17:51:52.420582 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 17:51:52.420728 14958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.416362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:44927 (local address 127.28.213.131:41745)
0808 17:51:52.416442 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:52.416453 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:52.416490 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:52.417184 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:52.417185 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:52.417186 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:51:52.417368 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:52.417370 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.418235 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.418236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:52.419415 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:52.419418 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.420320 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.420321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:52.420453 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.420457 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:51:52.420504 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 17:51:52.420542 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":78}
I20260808 17:51:52.420972 14973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.416646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:41745 (local address 127.28.213.129:44927)
0808 17:51:52.416686 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:52.416688 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:52.416696 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:51:52.416720 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:52.416721 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:52.416730 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:52.416786 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:51:52.417449 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.418147 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.419704 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.420218 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.420282 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.420290 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:52.420879 (+ 589us) server_negotiation.cc:299] Negotiation successful
0808 17:51:52.420916 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:51:52.421320 14995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.416398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:37107 (local address 127.28.213.131:36875)
0808 17:51:52.416983 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:52.416994 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:52.417056 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:52.417244 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:52.417245 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:52.417247 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:51:52.417424 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:52.417426 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.418400 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.418401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:52.419620 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:52.419624 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.420387 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.420388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:52.420467 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.420471 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:51:52.421166 (+ 695us) client_negotiation.cc:240] Negotiation successful
0808 17:51:52.421212 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":118,"threads_started":1}
I20260808 17:51:52.421432 14479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cd31a8198884338bd63ead7548bfcd5" candidate_uuid: "55f6bdbeb61644e58ec134b61f130bfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b1e59e889db4ce1addd49b82b3e351d" is_pre_election: true
I20260808 17:51:52.421550 14479 raft_consensus.cc:2454] T 3cd31a8198884338bd63ead7548bfcd5 P 4b1e59e889db4ce1addd49b82b3e351d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55f6bdbeb61644e58ec134b61f130bfc in term 0.
I20260808 17:51:52.421795 14801 leader_election.cc:302] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b1e59e889db4ce1addd49b82b3e351d, 55f6bdbeb61644e58ec134b61f130bfc; no voters:
I20260808 17:51:52.421831 14683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cd31a8198884338bd63ead7548bfcd5" candidate_uuid: "55f6bdbeb61644e58ec134b61f130bfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b34d9a6147824405bdc014d24c8f103b" is_pre_election: true
I20260808 17:51:52.421958 14683 raft_consensus.cc:2454] T 3cd31a8198884338bd63ead7548bfcd5 P b34d9a6147824405bdc014d24c8f103b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55f6bdbeb61644e58ec134b61f130bfc in term 0.
I20260808 17:51:52.422122 14992 raft_consensus.cc:2781] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:51:52.422183 14992 raft_consensus.cc:482] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:51:52.422209 14992 raft_consensus.cc:3037] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:51:52.423388 14992 raft_consensus.cc:504] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e59e889db4ce1addd49b82b3e351d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 44927 } } peers { permanent_uuid: "b34d9a6147824405bdc014d24c8f103b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37107 } } peers { permanent_uuid: "55f6bdbeb61644e58ec134b61f130bfc" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40081 } }
I20260808 17:51:52.423600 14992 leader_election.cc:288] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [CANDIDATE]: Term 1 election: Requested vote from peers 4b1e59e889db4ce1addd49b82b3e351d (127.28.213.129:44927), b34d9a6147824405bdc014d24c8f103b (127.28.213.130:37107)
I20260808 17:51:52.423780 14683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cd31a8198884338bd63ead7548bfcd5" candidate_uuid: "55f6bdbeb61644e58ec134b61f130bfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b34d9a6147824405bdc014d24c8f103b"
I20260808 17:51:52.423741 14479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cd31a8198884338bd63ead7548bfcd5" candidate_uuid: "55f6bdbeb61644e58ec134b61f130bfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b1e59e889db4ce1addd49b82b3e351d"
I20260808 17:51:52.423863 14683 raft_consensus.cc:3037] T 3cd31a8198884338bd63ead7548bfcd5 P b34d9a6147824405bdc014d24c8f103b [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:51:52.423869 14479 raft_consensus.cc:3037] T 3cd31a8198884338bd63ead7548bfcd5 P 4b1e59e889db4ce1addd49b82b3e351d [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:51:52.424983 14683 raft_consensus.cc:2454] T 3cd31a8198884338bd63ead7548bfcd5 P b34d9a6147824405bdc014d24c8f103b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55f6bdbeb61644e58ec134b61f130bfc in term 1.
I20260808 17:51:52.425158 14479 raft_consensus.cc:2454] T 3cd31a8198884338bd63ead7548bfcd5 P 4b1e59e889db4ce1addd49b82b3e351d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55f6bdbeb61644e58ec134b61f130bfc in term 1.
I20260808 17:51:52.425160 14797 leader_election.cc:302] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55f6bdbeb61644e58ec134b61f130bfc, b34d9a6147824405bdc014d24c8f103b; no voters:
I20260808 17:51:52.425340 14992 raft_consensus.cc:2781] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:51:52.425493 14992 raft_consensus.cc:686] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [term 1 LEADER]: Becoming Leader. State: Replica: 55f6bdbeb61644e58ec134b61f130bfc, State: Running, Role: LEADER
I20260808 17:51:52.425578 14992 consensus_queue.cc:237] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e59e889db4ce1addd49b82b3e351d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 44927 } } peers { permanent_uuid: "b34d9a6147824405bdc014d24c8f103b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37107 } } peers { permanent_uuid: "55f6bdbeb61644e58ec134b61f130bfc" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40081 } }
I20260808 17:51:52.425796 14996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.416409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:37107 (local address 127.28.213.129:43799)
0808 17:51:52.417200 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:52.417210 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:52.417286 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:52.417559 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:52.417560 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:52.417562 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:51:52.417843 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:52.417845 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.418899 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.418900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:52.420533 (+ 1633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:52.420536 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.421386 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.421387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:52.421492 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.421496 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:51:52.423800 (+ 2304us) client_negotiation.cc:240] Negotiation successful
0808 17:51:52.423844 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":754,"thread_start_us":147,"threads_started":1}
I20260808 17:51:52.423786 14997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.416646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:43799 (local address 127.28.213.130:37107)
0808 17:51:52.416980 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:52.416981 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:52.417351 (+ 370us) server_negotiation.cc:407] Connection header received
0808 17:51:52.417375 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:52.417376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:52.417384 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:52.417471 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:51:52.417925 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.418812 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.420614 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.421211 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.421298 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.421316 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:52.423677 (+ 2361us) server_negotiation.cc:299] Negotiation successful
0808 17:51:52.423720 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":82,"threads_started":1}
I20260808 17:51:52.427006 14683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cd31a8198884338bd63ead7548bfcd5" candidate_uuid: "4b1e59e889db4ce1addd49b82b3e351d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b34d9a6147824405bdc014d24c8f103b" is_pre_election: true
I20260808 17:51:52.427091 14683 raft_consensus.cc:2379] T 3cd31a8198884338bd63ead7548bfcd5 P b34d9a6147824405bdc014d24c8f103b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b1e59e889db4ce1addd49b82b3e351d in current term 1: Already voted for candidate 55f6bdbeb61644e58ec134b61f130bfc in this term.
I20260808 17:51:52.427693 14233 catalog_manager.cc:5495] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 55f6bdbeb61644e58ec134b61f130bfc (127.28.213.131). New cstate: current_term: 1 leader_uuid: "55f6bdbeb61644e58ec134b61f130bfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b1e59e889db4ce1addd49b82b3e351d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b34d9a6147824405bdc014d24c8f103b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55f6bdbeb61644e58ec134b61f130bfc" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 40081 } health_report { overall_health: HEALTHY } } }
I20260808 17:51:52.428612 14976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.417124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:34325 (local address 127.28.213.131:40081)
0808 17:51:52.417157 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:52.417158 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:52.419600 (+ 2442us) server_negotiation.cc:407] Connection header received
0808 17:51:52.419618 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:52.419619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:52.419628 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:52.419666 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:51:52.422250 (+ 2584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.422850 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.426466 (+ 3616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.427079 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.427130 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.427138 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:52.428521 (+ 1383us) server_negotiation.cc:299] Negotiation successful
0808 17:51:52.428559 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:51:52.428668 14998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.416926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:40081 (local address 127.28.213.129:34325)
0808 17:51:52.419276 (+ 2350us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:52.419286 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:51:52.419347 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:51:52.421954 (+ 2607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:51:52.421955 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:51:52.421957 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:51:52.422157 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:52.422159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.422945 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.422945 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:52.426337 (+ 3392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:51:52.426340 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.428188 (+ 1848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.428189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:51:52.428426 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.428434 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 17:51:52.428492 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 17:51:52.428533 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2259,"thread_start_us":121,"threads_started":1}
I20260808 17:51:52.429029 14871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cd31a8198884338bd63ead7548bfcd5" candidate_uuid: "4b1e59e889db4ce1addd49b82b3e351d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55f6bdbeb61644e58ec134b61f130bfc" is_pre_election: true
I20260808 17:51:52.429445 14384 leader_election.cc:302] T 3cd31a8198884338bd63ead7548bfcd5 P 4b1e59e889db4ce1addd49b82b3e351d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b1e59e889db4ce1addd49b82b3e351d; no voters: 55f6bdbeb61644e58ec134b61f130bfc, b34d9a6147824405bdc014d24c8f103b
I20260808 17:51:52.429574 14985 raft_consensus.cc:2726] T 3cd31a8198884338bd63ead7548bfcd5 P 4b1e59e889db4ce1addd49b82b3e351d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 17:51:52.445915 14976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.442865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33478 (local address 127.28.213.131:40081)
0808 17:51:52.442908 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:51:52.442910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:51:52.442918 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:51:52.442990 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:51:52.442991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:51:52.443009 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:51:52.443069 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:51:52.443236 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.443885 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.444982 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:51:52.445312 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:51:52.445385 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:51:52.445563 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:51:52.445681 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:51:52.445766 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 17:51:52.445830 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 17:51:52.445850 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:51:52.447788 14479 raft_consensus.cc:1261] T 3cd31a8198884338bd63ead7548bfcd5 P 4b1e59e889db4ce1addd49b82b3e351d [term 1 FOLLOWER]: Refusing update from remote peer 55f6bdbeb61644e58ec134b61f130bfc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:51:52.447798 14683 raft_consensus.cc:1261] T 3cd31a8198884338bd63ead7548bfcd5 P b34d9a6147824405bdc014d24c8f103b [term 1 FOLLOWER]: Refusing update from remote peer 55f6bdbeb61644e58ec134b61f130bfc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:51:52.448089 14999 consensus_queue.cc:1035] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b34d9a6147824405bdc014d24c8f103b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:51:52.448932 14992 consensus_queue.cc:1035] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b1e59e889db4ce1addd49b82b3e351d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:51:52.454705 15004 mvcc.cc:205] Tried to move back new op lower bound from 7316322354983419904 to 7316322354897846272. Current Snapshot: MvccSnapshot[applied={T|T < 7316322354983419904 or (T in {7316322354983419904})}]
I20260808 17:51:52.455554 15005 mvcc.cc:205] Tried to move back new op lower bound from 7316322354983419904 to 7316322354897846272. Current Snapshot: MvccSnapshot[applied={T|T < 7316322354983419904}]
I20260808 17:51:52.456591 14230 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:51:52.456684 14230 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:51:52.457614 14230 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 884f5e35d50e4948800652fecef2d55c: Sending DeleteTablet for 3 replicas of tablet 3cd31a8198884338bd63ead7548bfcd5
I20260808 17:51:52.457955 14857 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cd31a8198884338bd63ead7548bfcd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:51:52 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:33476
I20260808 17:51:52.458009 14450 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cd31a8198884338bd63ead7548bfcd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:51:52 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:52448
I20260808 17:51:52.458379 14654 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cd31a8198884338bd63ead7548bfcd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:51:52 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:47328
I20260808 17:51:52.458576 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 14350
I20260808 17:51:52.465498 15020 tablet_replica.cc:330] T 3cd31a8198884338bd63ead7548bfcd5 P b34d9a6147824405bdc014d24c8f103b: stopping tablet replica
I20260808 17:51:52.465596 15020 raft_consensus.cc:2229] T 3cd31a8198884338bd63ead7548bfcd5 P b34d9a6147824405bdc014d24c8f103b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:51:52.465688 15020 raft_consensus.cc:2258] T 3cd31a8198884338bd63ead7548bfcd5 P b34d9a6147824405bdc014d24c8f103b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:51:52.465935 15017 tablet_replica.cc:330] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc: stopping tablet replica
I20260808 17:51:52.466025 15017 raft_consensus.cc:2229] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:51:52.466133 15017 raft_consensus.cc:2258] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 17:51:52.474324 14211 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.213.129:44927 (error 108)
I20260808 17:51:52.474984 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 14553
I20260808 17:51:52.488324 14977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.488199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:44927 (local address 127.0.0.1:52452)
0808 17:51:52.488246 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:52.488287 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.129:44927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 17:51:52.488428 14211 catalog_manager.cc:4584] TS 4b1e59e889db4ce1addd49b82b3e351d (127.28.213.129:44927): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3cd31a8198884338bd63ead7548bfcd5: Network error: Client connection negotiation failed: client connection to 127.28.213.129:44927: connect: Connection refused (error 111)
I20260808 17:51:52.490816 15017 ts_tablet_manager.cc:1905] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:51:52.492980 15017 ts_tablet_manager.cc:1918] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:51:52.493140 15017 log.cc:1196] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/3cd31a8198884338bd63ead7548bfcd5
I20260808 17:51:52.493863 15017 ts_tablet_manager.cc:1939] T 3cd31a8198884338bd63ead7548bfcd5 P 55f6bdbeb61644e58ec134b61f130bfc: Deleting consensus metadata
I20260808 17:51:52.494465 14212 catalog_manager.cc:4841] TS 55f6bdbeb61644e58ec134b61f130bfc (127.28.213.131:40081): tablet 3cd31a8198884338bd63ead7548bfcd5 (table test-table [id=97b2d73ef94e40e396ffe0bc0e9c8e3b]) successfully deleted
I20260808 17:51:52.504061 14977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:51:52.503954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:37107 (local address 127.0.0.1:47342)
0808 17:51:52.504004 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 17:51:52.504028 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.130:37107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 17:51:52.504606 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 14772
I20260808 17:51:52.513882 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 14187
I20260808 17:51:52.521883 29526 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 17:51:52.865036 29526 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 17:51:52.865137 29526 mini_ranger.cc:66] Stopping Ranger...
I20260808 17:51:53.208647 29526 mini_ranger.cc:68] Stopped Ranger
2026-08-08 17:51:53.208 UTC [13592] LOG: received smart shutdown request
2026-08-08 17:51:53.212 UTC [13592] LOG: background worker "logical replication launcher" (PID 13605) exited with exit code 1
2026-08-08 17:51:53.212 UTC [13596] LOG: shutting down
2026-08-08 17:51:53.347 UTC [13592] LOG: database system is shut down
2026-08-08T17:51:53Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (46853 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:51:53 dist-test-slave-bndk krb5kdc[15036](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:51:53 dist-test-slave-bndk krb5kdc[15036](info): set up 2 sockets
Aug 08 17:51:53 dist-test-slave-bndk krb5kdc[15036](info): commencing operation
krb5kdc: starting...
W20260808 17:51:54.564234 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:51:54 dist-test-slave-bndk krb5kdc[15036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211514, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:51:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:51:54Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.28.213.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.28.213.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.28.213.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/rangeradmin_127.28.213.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.28.213.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/rangeradmin_127.28.213.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.28.213.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.28.213.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.28.213.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/rangerlookup_127.28.213.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.28.213.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/rangerlookup_127.28.213.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.28.213.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.28.213.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.28.213.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/HTTP_127.28.213.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.28.213.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/HTTP_127.28.213.148@KRBTEST.COM.keytab.
I20260808 17:51:54.728883 29526 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskxAQlY3/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/postgres -l logfile start
2026-08-08 17:51:56.873 UTC [15079] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 17:51:56.873 UTC [15079] LOG: listening on IPv4 address "127.28.213.148", port 59111
2026-08-08 17:51:56.876 UTC [15079] LOG: listening on Unix socket "/tmp/.s.PGSQL.59111"
2026-08-08 17:51:56.895 UTC [15085] LOG: database system was shut down at 2026-08-08 17:51:55 UTC
2026-08-08 17:51:56.898 UTC [15079] LOG: database system is ready to accept connections
I20260808 17:51:57.930186 29526 mini_postgres.cc:96] Postgres bound to 59111
2026-08-08 17:51:57.936 UTC [15098] FATAL: database "slave" does not exist
127.28.213.148:59111 - accepting connections
I20260808 17:51:57.937281 29526 mini_ranger.cc:161] Starting Ranger...
I20260808 17:51:57.951134 29526 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 17:51:58.331166 29526 mini_ranger.cc:87] Created ranger Postgres database
I20260808 17:51:58.331236 29526 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ranger-admin
2026-08-08 17:51:58,597 [I] DB FLAVOR :POSTGRES
2026-08-08 17:51:58,597 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 17:51:58,597 [I] Checking connection..
2026-08-08 17:51:58,597 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 17:51:58,843 [I] Checking connection passed.
2026-08-08 17:51:58,843 [I] --------- Verifying version history table ---------
2026-08-08 17:51:58,844 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 17:51:59,095 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 17:51:59,095 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 17:51:59,346 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 17:51:59,346 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 17:51:59,346 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 17:51:59.571 UTC [15193] WARNING: there is no transaction in progress
2026-08-08 17:51:59,578 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 17:51:59,579 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 17:51:59,817 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 17:51:59,818 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 17:51:59,818 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 17:52:00,044 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 17:52:00,273 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-bndk.c.gcp-upstream.internal','N') ;"
2026-08-08 17:52:00,512 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 17:52:00,762 [I] Table x_portal_user does not exist in database ranger
2026-08-08 17:52:00,762 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 17:52:01,006 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 17:52:01,007 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 17:52:01,255 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 17:52:01,480 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 17:52:01,481 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 17:52:02.331 UTC [15365] WARNING: there is no transaction in progress
2026-08-08 17:52:02.345 UTC [15365] WARNING: there is no transaction in progress
2026-08-08 17:52:02.359 UTC [15365] WARNING: there is no transaction in progress
2026-08-08 17:52:02.373 UTC [15365] WARNING: there is no transaction in progress
2026-08-08 17:52:02.389 UTC [15365] WARNING: there is no transaction in progress
2026-08-08 17:52:02.403 UTC [15365] WARNING: there is no transaction in progress
2026-08-08 17:52:02.452 UTC [15365] WARNING: there is no transaction in progress
2026-08-08 17:52:02.457 UTC [15365] WARNING: there is no transaction in progress
2026-08-08 17:52:02.469 UTC [15365] WARNING: there is no transaction in progress
2026-08-08 17:52:02.478 UTC [15365] WARNING: there is no transaction in progress
2026-08-08 17:52:02.487 UTC [15365] WARNING: there is no transaction in progress
2026-08-08 17:52:02.499 UTC [15365] WARNING: there is no transaction in progress
2026-08-08 17:52:02.508 UTC [15365] WARNING: there is no transaction in progress
2026-08-08 17:52:02.513 UTC [15365] WARNING: there is no transaction in progress
2026-08-08 17:52:02.519 UTC [15365] WARNING: there is no transaction in progress
2026-08-08 17:52:02.525 UTC [15365] WARNING: there is no transaction in progress
2026-08-08 17:52:03,048 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 17:52:03,048 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 17:52:03,294 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 17:52:03,294 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 17:52:03,542 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 17:52:03,542 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 17:52:03,799 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 17:52:03,799 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 17:52:04,048 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 17:52:04,291 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-bndk.c.gcp-upstream.internal';"
2026-08-08 17:52:04,523 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 17:52:04,524 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 17:52:04,758 [I] DB_PATCHES have already been applied
I20260808 17:52:04.764340 29526 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ranger-admin:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskxAQlY3/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 17:52:04.764405 29526 mini_ranger.cc:193] Using host: 127.28.213.148
I20260808 17:52:04.768181 29526 mini_ranger.cc:227] Ranger admin URL: http://127.28.213.148:49663
Aug 08, 2026 5:52:05 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:52:05 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:52:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 5:52:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 5:52:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 5:52:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 5:52:05 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 17:52:05.949690 29526 mini_ranger.cc:160] Time spent starting Ranger: real 8.012s user 0.000s sys 0.009s
Aug 08, 2026 5:52:24 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 5:52:24 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 5:52:24 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 5:52:24 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 5:52:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 5:52:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 5:52:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 5:52:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 5:52:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 5:52:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 5:52:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 5:52:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 5:52:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 5:52:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 5:52:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 5:52:24 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 5:52:24 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 5:52:25 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 17:52:26.208814 29526 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.28.213.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.28.213.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.28.213.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/rangerkms_127.28.213.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.28.213.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/rangerkms_127.28.213.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.28.213.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.28.213.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.28.213.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/HTTP_127.28.213.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.28.213.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/HTTP_127.28.213.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 17:52:26 dist-test-slave-bndk krb5kdc[15036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211546, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 17:52:26.285321 29526 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 17:52:26.293385 29526 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 17:52:26.962114 29526 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 17:52:26.962184 29526 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ranger-kms
I20260808 17:52:26.962195 29526 mini_ranger_kms.cc:227] Using postgres at 127.28.213.148:59111
2026-08-08 17:52:27,118 [I] DB FLAVOR :POSTGRES
2026-08-08 17:52:27,118 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 17:52:27,118 [I] Checking connection
2026-08-08 17:52:27,118 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 17:52:27,355 [I] connection success
2026-08-08 17:52:27,355 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 17:52:27,355 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 17:52:27,355 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 17:52:27,587 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 17:52:27,587 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 17:52:27,587 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 17:52:27,587 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.213.148:59111/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 17:52:27,841 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 17:52:28.236130 29526 mini_ranger_kms.cc:310] Created kms service
I20260808 17:52:28.438886 29526 mini_ranger_kms.cc:326] Created kudu user
I20260808 17:52:28.476645 29526 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 17:52:28 dist-test-slave-bndk krb5kdc[15036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211546, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.28.213.148@KRBTEST.COM
I20260808 17:52:28.827877 29526 mini_ranger_kms.cc:384] Added ranger policy
I20260808 17:52:28.827994 29526 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ranger-kms:/tmp/dist-test-taskxAQlY3/build/release/bin/postgresql.jar:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskxAQlY3/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 17:52:28.828016 29526 mini_ranger_kms.cc:240] Using host: 127.28.213.148
I20260808 17:52:28.832057 29526 mini_ranger_kms.cc:276] Ranger KMS PID: 15638
I20260808 17:52:28.832134 29526 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.28.213.148:39699
Aug 08, 2026 5:52:29 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:52:29 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:52:29 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 5:52:29 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 5:52:30 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 5:52:30 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 17:52:31 dist-test-slave-bndk krb5kdc[15036](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786211551, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.28.213.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:31.195022 29526 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 4.910s user 0.014s sys 0.125s
I20260808 17:52:31.195135 29526 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 17:52:31.195187 29526 mini_ranger_kms.cc:401] 127.28.213.148:39699/kms/v1/keys
Aug 08 17:52:31 dist-test-slave-bndk krb5kdc[15036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211551, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.28.213.148@KRBTEST.COM for HTTP/127.28.213.148@KRBTEST.COM
Aug 08 17:52:31 dist-test-slave-bndk krb5kdc[15036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211551, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.28.213.148@KRBTEST.COM for HTTP/127.28.213.148@KRBTEST.COM
Aug 08 17:52:33 dist-test-slave-bndk krb5kdc[15036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211553, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:52:33.993750 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:38433
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:38433
--ranger_config_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.213.148:39699/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:52:34.072238 15708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:34.072427 15708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:34.072458 15708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:34.073606 15708 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:52:34.073645 15708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:34.073665 15708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:34.073680 15708 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:52:34.073696 15708 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:52:34.075181 15708 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/wal
--ranger_kms_url=127.28.213.148:39699/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:38433
--ranger_config_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:38433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:34.075398 15708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:34.075598 15708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:34.079988 15723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:34.080026 15721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:34.080022 15720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:34.080113 15708 server_base.cc:1034] running on GCE node
I20260808 17:52:34.080401 15708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:34.080647 15708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:34.081779 15708 hybrid_clock.cc:648] HybridClock initialized: now 1786211554081766 us; error 29 us; skew 500 ppm
Aug 08 17:52:34 dist-test-slave-bndk krb5kdc[15036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211554, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:34.087813 15708 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:52:34.088224 15708 webserver.cc:460] Webserver started at http://127.28.213.190:43279/ using document root <none> and password file <none>
I20260808 17:52:34.088402 15708 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:34.088441 15708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:34.088564 15708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 17:52:34 dist-test-slave-bndk krb5kdc[15036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211554, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for HTTP/127.28.213.148@KRBTEST.COM
I20260808 17:52:34.132550 15708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "2778cb57ed414779a0cf489d47cae679"
format_stamp: "Formatted at 2026-08-08 17:52:34 on dist-test-slave-bndk"
server_key: "b2c02fe358a0cef4833bbcedee451036"
server_key_iv: "b90eed899f7f57e41695fb940cf6c0ea"
server_key_version: "kuduclusterkey@0"
I20260808 17:52:34.132962 15708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "2778cb57ed414779a0cf489d47cae679"
format_stamp: "Formatted at 2026-08-08 17:52:34 on dist-test-slave-bndk"
server_key: "b2c02fe358a0cef4833bbcedee451036"
server_key_iv: "b90eed899f7f57e41695fb940cf6c0ea"
server_key_version: "kuduclusterkey@0"
I20260808 17:52:34.134388 15708 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:52:34.145658 15735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:34.145819 15708 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 17:52:34.145920 15708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "2778cb57ed414779a0cf489d47cae679"
format_stamp: "Formatted at 2026-08-08 17:52:34 on dist-test-slave-bndk"
server_key: "b2c02fe358a0cef4833bbcedee451036"
server_key_iv: "b90eed899f7f57e41695fb940cf6c0ea"
server_key_version: "kuduclusterkey@0"
I20260808 17:52:34.146013 15708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:34.166075 15708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:34.167829 15708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:34.167953 15708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:34.171937 15708 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:38433
I20260808 17:52:34.172042 15817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:38433 every 8 connection(s)
I20260808 17:52:34.172387 15708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:52:34.173079 15818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:52:34.175379 15818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679: Bootstrap starting.
I20260808 17:52:34.175947 15818 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679: Neither blocks nor log segments found. Creating new log.
I20260808 17:52:34.176211 15818 log.cc:824] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679: Log is configured to *not* fsync() on all Append() calls
I20260808 17:52:34.176874 15818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679: No bootstrap required, opened a new log
I20260808 17:52:34.178547 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 15708
I20260808 17:52:34.178653 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:52:34.178846 29526 external_mini_cluster.cc:1428] Setting key 98ea05c9728ae4dea91196c7c46f3a1c
I20260808 17:52:34.178973 15818 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2778cb57ed414779a0cf489d47cae679" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38433 } }
I20260808 17:52:34.179159 15818 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:52:34.179234 15818 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2778cb57ed414779a0cf489d47cae679, State: Initialized, Role: FOLLOWER
I20260808 17:52:34.179392 15818 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2778cb57ed414779a0cf489d47cae679" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38433 } }
I20260808 17:52:34.179585 15818 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:52:34.179639 15818 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:52:34.179723 15818 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:52:34.180364 15818 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2778cb57ed414779a0cf489d47cae679" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38433 } }
I20260808 17:52:34.180469 15818 leader_election.cc:302] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2778cb57ed414779a0cf489d47cae679; no voters:
I20260808 17:52:34.180626 15818 leader_election.cc:288] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:52:34.180970 15818 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:52:34.180663 15826 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:52:34.182282 15826 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [term 1 LEADER]: Becoming Leader. State: Replica: 2778cb57ed414779a0cf489d47cae679, State: Running, Role: LEADER
I20260808 17:52:34.182413 15826 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2778cb57ed414779a0cf489d47cae679" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38433 } }
I20260808 17:52:34.183064 15827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2778cb57ed414779a0cf489d47cae679" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2778cb57ed414779a0cf489d47cae679" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38433 } } }
I20260808 17:52:34.183142 15827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [sys.catalog]: This master's current role is: LEADER
I20260808 17:52:34.183723 15818 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 17:52:34.184087 15843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2778cb57ed414779a0cf489d47cae679. Latest consensus state: current_term: 1 leader_uuid: "2778cb57ed414779a0cf489d47cae679" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2778cb57ed414779a0cf489d47cae679" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38433 } } }
I20260808 17:52:34.184159 15843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [sys.catalog]: This master's current role is: LEADER
I20260808 17:52:34.186048 15845 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 08 17:52:34 dist-test-slave-bndk krb5kdc[15036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211553, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:52:34.189821 15845 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:52:34.191816 15824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:34.179508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35902 (local address 127.28.213.190:38433)
0808 17:52:34.179689 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:34.179699 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:34.179734 (+ 35us) server_negotiation.cc:407] Connection header received
0808 17:52:34.179850 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:34.179858 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:34.179914 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:34.180054 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:34.180778 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:34.182240 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:34.183284 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:34.183904 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:34.184018 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:34.186951 (+ 2933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:34.186990 (+ 39us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:34.186990 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:34.187063 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:34.189629 (+ 2566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:34.190036 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:34.190039 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:34.190040 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:34.190162 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:34.190363 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:34.190363 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:34.190364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:34.190701 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:34.191358 (+ 657us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:34.191432 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 17:52:34.191583 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":84,"threads_started":1}
I20260808 17:52:34.193894 15845 catalog_manager.cc:1347] Generated new cluster ID: 5e2a325ae5aa4c049788fdf72ae48952
I20260808 17:52:34.194002 15845 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:52:34.205631 15845 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:52:34.206418 15845 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:52:34.211563 15845 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679: Generated new TSK 0
I20260808 17:52:34.211792 15845 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
I20260808 17:52:34.912101 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.213.148:39699/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38433
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:52:34.997963 15885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:34.998142 15885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:34.998162 15885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:34.999264 15885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:34.999305 15885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:34.999337 15885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:52:35.000718 15885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.28.213.148:39699/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:35.000938 15885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:35.001166 15885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:35.005810 15895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:35.005934 15896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:35.005824 15900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:35.006115 15885 server_base.cc:1034] running on GCE node
I20260808 17:52:35.006353 15885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:35.006580 15885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:35.007730 15885 hybrid_clock.cc:648] HybridClock initialized: now 1786211555007613 us; error 125 us; skew 500 ppm
Aug 08 17:52:35 dist-test-slave-bndk krb5kdc[15036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211555, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:35.010174 15885 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:52:35.010564 15885 webserver.cc:460] Webserver started at http://127.28.213.129:45379/ using document root <none> and password file <none>
I20260808 17:52:35.010759 15885 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:35.010807 15885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:35.010932 15885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 17:52:35 dist-test-slave-bndk krb5kdc[15036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211555, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for HTTP/127.28.213.148@KRBTEST.COM
I20260808 17:52:35.022384 15885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "108e2c8237f6439b8b748accecb3852c"
format_stamp: "Formatted at 2026-08-08 17:52:35 on dist-test-slave-bndk"
server_key: "813761f46d5584587b452a3c41742b5b"
server_key_iv: "4705c380a02b7235a9ff2c39cc14dbff"
server_key_version: "kuduclusterkey@0"
I20260808 17:52:35.022893 15885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "108e2c8237f6439b8b748accecb3852c"
format_stamp: "Formatted at 2026-08-08 17:52:35 on dist-test-slave-bndk"
server_key: "813761f46d5584587b452a3c41742b5b"
server_key_iv: "4705c380a02b7235a9ff2c39cc14dbff"
server_key_version: "kuduclusterkey@0"
I20260808 17:52:35.027478 15885 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.000s
I20260808 17:52:35.039798 15909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:35.039999 15885 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:52:35.040100 15885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "108e2c8237f6439b8b748accecb3852c"
format_stamp: "Formatted at 2026-08-08 17:52:35 on dist-test-slave-bndk"
server_key: "813761f46d5584587b452a3c41742b5b"
server_key_iv: "4705c380a02b7235a9ff2c39cc14dbff"
server_key_version: "kuduclusterkey@0"
I20260808 17:52:35.040171 15885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:35.085894 15885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:35.088176 15885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:35.088316 15885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:35.088577 15885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:52:35.088928 15885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:52:35.088974 15885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:35.089003 15885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:52:35.089063 15885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:35.096068 15885 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:41183
I20260808 17:52:35.096163 16083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:41183 every 8 connection(s)
I20260808 17:52:35.096509 15885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:52:35.098098 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 15885
I20260808 17:52:35.098201 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:52:35.098390 29526 external_mini_cluster.cc:1428] Setting key ab1d4bde477fae72516f00166b5e0171
Aug 08 17:52:35 dist-test-slave-bndk krb5kdc[15036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211555, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:52:35.107808 16086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:35.097246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:54549 (local address 127.28.213.190:38433)
0808 17:52:35.097382 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:35.097384 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:35.097686 (+ 302us) server_negotiation.cc:407] Connection header received
0808 17:52:35.098290 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:35.098292 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:35.098307 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:35.098353 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:35.099161 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:35.099798 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:35.101391 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:35.101694 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:35.101746 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:35.104340 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:35.104342 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:35.104342 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:35.104350 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:35.106154 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:35.106656 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:35.106657 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:35.106657 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:35.106729 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:35.107036 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:35.107037 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:35.107038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:35.107183 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:35.107231 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:35.107615 (+ 384us) server_negotiation.cc:299] Negotiation successful
0808 17:52:35.107706 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":80,"threads_started":1}
I20260808 17:52:35.108563 16087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:35.097206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38433 (local address 127.28.213.129:54549)
0808 17:52:35.097566 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:35.097604 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:35.098158 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:35.098547 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:35.098552 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:35.098773 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:35.099045 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:35.099052 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:35.099919 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:35.099920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:35.101283 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:35.101287 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:35.101853 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:35.101854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:35.102010 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:35.102545 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:35.102555 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:35.104222 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:35.106253 (+ 2031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:35.106260 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:35.106262 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:35.106559 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:35.106804 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:35.106804 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:35.106805 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:35.106952 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:35.107283 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:35.107290 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:35.107447 (+ 157us) client_negotiation.cc:769] Sending connection context
0808 17:52:35.108167 (+ 720us) client_negotiation.cc:240] Negotiation successful
0808 17:52:35.108332 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":85,"threads_started":1}
WARNING: no policy specified for kudu/127.28.213.130@KRBTEST.COM; defaulting to no policy
I20260808 17:52:35.109335 16084 heartbeater.cc:347] Connected to a master server at 127.28.213.190:38433
I20260808 17:52:35.109447 16084 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:35.109670 16084 heartbeater.cc:511] Master 127.28.213.190:38433 requested a full tablet report, sending...
I20260808 17:52:35.110261 15759 ts_manager.cc:194] Registered new tserver with Master: 108e2c8237f6439b8b748accecb3852c (127.28.213.129:41183)
I20260808 17:52:35.111240 15759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:54549
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
I20260808 17:52:35.126120 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.213.148:39699/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38433
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 17:52:35 dist-test-slave-bndk krb5kdc[15036](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786211555, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 17:52:35.243515 16090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:35.243832 16090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:35.243916 16090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:35.245729 16090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:35.245826 16090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:35.245906 16090 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:52:35.248132 16090 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.28.213.148:39699/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16090
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:35.248596 16090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:35.248907 16090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:35.255447 16105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:35.255587 16103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:35.256130 16090 server_base.cc:1034] running on GCE node
W20260808 17:52:35.256314 16102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:35.256615 16090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:35.256881 16090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:35.258044 16090 hybrid_clock.cc:648] HybridClock initialized: now 1786211555258021 us; error 44 us; skew 500 ppm
Aug 08 17:52:35 dist-test-slave-bndk krb5kdc[15036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211555, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:35.261889 16090 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:52:35.262454 16090 webserver.cc:460] Webserver started at http://127.28.213.130:40087/ using document root <none> and password file <none>
I20260808 17:52:35.262773 16090 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:35.262869 16090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:35.263037 16090 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 17:52:35 dist-test-slave-bndk krb5kdc[15036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211555, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for HTTP/127.28.213.148@KRBTEST.COM
I20260808 17:52:35.279033 16090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "85a6572bd01942fda6897dd629591390"
format_stamp: "Formatted at 2026-08-08 17:52:35 on dist-test-slave-bndk"
server_key: "6d813997ff049cdc49a14e9568ded1eb"
server_key_iv: "2417418ec123a29378c58042401e04f6"
server_key_version: "kuduclusterkey@0"
I20260808 17:52:35.279464 16090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "85a6572bd01942fda6897dd629591390"
format_stamp: "Formatted at 2026-08-08 17:52:35 on dist-test-slave-bndk"
server_key: "6d813997ff049cdc49a14e9568ded1eb"
server_key_iv: "2417418ec123a29378c58042401e04f6"
server_key_version: "kuduclusterkey@0"
I20260808 17:52:35.284070 16090 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 17:52:35.297288 16114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:35.297537 16090 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 17:52:35.297638 16090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "85a6572bd01942fda6897dd629591390"
format_stamp: "Formatted at 2026-08-08 17:52:35 on dist-test-slave-bndk"
server_key: "6d813997ff049cdc49a14e9568ded1eb"
server_key_iv: "2417418ec123a29378c58042401e04f6"
server_key_version: "kuduclusterkey@0"
I20260808 17:52:35.297721 16090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:35.336324 16090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:35.338909 16090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:35.339118 16090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:35.339468 16090 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:52:35.339941 16090 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:52:35.340044 16090 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:35.340117 16090 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:52:35.340173 16090 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:35.347080 16090 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:46515
I20260808 17:52:35.347592 16090 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:52:35.350461 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 16090
I20260808 17:52:35.350557 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:52:35.350754 29526 external_mini_cluster.cc:1428] Setting key 47ab13bdd52eb6f6638b64bf42f4fbc1
Aug 08 17:52:35 dist-test-slave-bndk krb5kdc[15036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211555, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:52:35.350344 16283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:46515 every 8 connection(s)
I20260808 17:52:35.363196 16086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:35.351388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:53129 (local address 127.28.213.190:38433)
0808 17:52:35.351449 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:35.351451 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:35.351593 (+ 142us) server_negotiation.cc:407] Connection header received
0808 17:52:35.352244 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:35.352246 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:35.352282 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:35.352312 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:35.353101 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:35.353831 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:35.355325 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:35.355644 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:35.355684 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:35.358285 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:35.358287 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:35.358287 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:35.358294 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:35.359960 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:35.360446 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:35.360447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:35.360448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:35.360569 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:35.362404 (+ 1835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:35.362406 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:35.362406 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:35.362550 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:35.362597 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:35.362995 (+ 398us) server_negotiation.cc:299] Negotiation successful
0808 17:52:35.363098 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 17:52:35.363999 16293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:35.351083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38433 (local address 127.28.213.130:53129)
0808 17:52:35.351468 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:35.351512 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:35.352126 (+ 614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:35.352502 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:35.352507 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:35.352732 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:35.352996 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:35.353002 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:35.353947 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:35.353948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:35.355208 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:35.355211 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:35.355784 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:35.355785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:35.355921 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:35.356473 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:35.356483 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:35.358165 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:35.360055 (+ 1890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:35.360062 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:35.360064 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:35.360352 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:35.360650 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:35.360651 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:35.360652 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:35.362305 (+ 1653us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:35.362647 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:35.362653 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:35.362828 (+ 175us) client_negotiation.cc:769] Sending connection context
0808 17:52:35.363581 (+ 753us) client_negotiation.cc:240] Negotiation successful
0808 17:52:35.363748 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":83,"threads_started":1}
I20260808 17:52:35.364692 16288 heartbeater.cc:347] Connected to a master server at 127.28.213.190:38433
I20260808 17:52:35.364787 16288 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:35.364959 16288 heartbeater.cc:511] Master 127.28.213.190:38433 requested a full tablet report, sending...
I20260808 17:52:35.365381 15759 ts_manager.cc:194] Registered new tserver with Master: 85a6572bd01942fda6897dd629591390 (127.28.213.130:46515)
I20260808 17:52:35.365868 15759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:53129
WARNING: no policy specified for kudu/127.28.213.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
I20260808 17:52:35.388214 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.213.148:39699/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38433
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:52:35.531139 16296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:35.531424 16296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:35.531458 16296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:35.532616 16296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:35.532657 16296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:35.532681 16296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:52:35.534261 16296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.28.213.148:39699/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:38433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:35.534492 16296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:35.534718 16296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:35.539831 16304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:35.539831 16306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:35.540088 16303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:35.540546 16296 server_base.cc:1034] running on GCE node
I20260808 17:52:35.540743 16296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:35.540964 16296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:35.542105 16296 hybrid_clock.cc:648] HybridClock initialized: now 1786211555542092 us; error 29 us; skew 500 ppm
Aug 08 17:52:35 dist-test-slave-bndk krb5kdc[15036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211555, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:35.545099 16296 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:52:35.545532 16296 webserver.cc:460] Webserver started at http://127.28.213.131:38749/ using document root <none> and password file <none>
I20260808 17:52:35.545742 16296 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:35.545783 16296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:35.545898 16296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 17:52:35 dist-test-slave-bndk krb5kdc[15036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211555, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for HTTP/127.28.213.148@KRBTEST.COM
I20260808 17:52:35.558513 16296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "e91003c4b3c74618bd89073a86e61852"
format_stamp: "Formatted at 2026-08-08 17:52:35 on dist-test-slave-bndk"
server_key: "9d6a60512dd1387242e9794803236c62"
server_key_iv: "b392f5cc5ff7a4e51b9d7a68440ce9d1"
server_key_version: "kuduclusterkey@0"
I20260808 17:52:35.559024 16296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "e91003c4b3c74618bd89073a86e61852"
format_stamp: "Formatted at 2026-08-08 17:52:35 on dist-test-slave-bndk"
server_key: "9d6a60512dd1387242e9794803236c62"
server_key_iv: "b392f5cc5ff7a4e51b9d7a68440ce9d1"
server_key_version: "kuduclusterkey@0"
I20260808 17:52:35.565752 16296 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.001s
I20260808 17:52:35.580484 16315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:35.580727 16296 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 17:52:35.580835 16296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "e91003c4b3c74618bd89073a86e61852"
format_stamp: "Formatted at 2026-08-08 17:52:35 on dist-test-slave-bndk"
server_key: "9d6a60512dd1387242e9794803236c62"
server_key_iv: "b392f5cc5ff7a4e51b9d7a68440ce9d1"
server_key_version: "kuduclusterkey@0"
I20260808 17:52:35.580927 16296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:35.601629 16296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:35.603888 16296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:35.604118 16296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:35.604403 16296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:52:35.604777 16296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:52:35.604843 16296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:35.604878 16296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:52:35.604894 16296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:35.616272 16296 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:46453
I20260808 17:52:35.616667 16296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:52:35.620245 16512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:46453 every 8 connection(s)
I20260808 17:52:35.621712 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 16296
I20260808 17:52:35.621824 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:52:35.622011 29526 external_mini_cluster.cc:1428] Setting key b7404a7b07fb125868c3536229094648
Aug 08 17:52:35 dist-test-slave-bndk krb5kdc[15036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211555, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:52:35.631701 16086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:35.620870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:43447 (local address 127.28.213.190:38433)
0808 17:52:35.620917 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:35.620919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:35.621391 (+ 472us) server_negotiation.cc:407] Connection header received
0808 17:52:35.622150 (+ 759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:35.622151 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:35.622165 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:35.622196 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:35.623237 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:35.624016 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:35.625609 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:35.625926 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:35.625967 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:35.628524 (+ 2557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:35.628526 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:35.628526 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:35.628534 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:35.630148 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:35.630643 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:35.630645 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:35.630645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:35.630710 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:35.630992 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:35.630994 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:35.630994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:35.631128 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:35.631196 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:35.631513 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 17:52:35.631604 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:52:35.631860 16518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:35.620839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38433 (local address 127.28.213.131:43447)
0808 17:52:35.621232 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:35.621276 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:35.622023 (+ 747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:35.622378 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:35.622382 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:35.622784 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:35.623125 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:35.623132 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:35.624135 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:35.624136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:35.625505 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:35.625509 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:35.626069 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:35.626070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:35.626214 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:35.626786 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:35.626797 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:35.628423 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:35.630242 (+ 1819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:35.630249 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:35.630251 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:35.630534 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:35.630781 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:35.630782 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:35.630783 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:35.630922 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:35.631194 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:35.631198 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:35.631367 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 17:52:35.631477 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 17:52:35.631626 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":146,"threads_started":1}
I20260808 17:52:35.632328 16514 heartbeater.cc:347] Connected to a master server at 127.28.213.190:38433
I20260808 17:52:35.632436 16514 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:35.632624 16514 heartbeater.cc:511] Master 127.28.213.190:38433 requested a full tablet report, sending...
I20260808 17:52:35.633046 15759 ts_manager.cc:194] Registered new tserver with Master: e91003c4b3c74618bd89073a86e61852 (127.28.213.131:46453)
I20260808 17:52:35.633544 15759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:43447
I20260808 17:52:35.634887 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:52:35.635567 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 15885
I20260808 17:52:35.662955 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 16090
I20260808 17:52:35.709587 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 16296
I20260808 17:52:35.719779 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 15708
I20260808 17:52:35.728387 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:38433
--webserver_interface=127.28.213.190
--webserver_port=43279
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:38433
--ranger_config_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.213.148:39699/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.28.213.148:39699/kms with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:52:35.808960 16519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:35.809144 16519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:35.809165 16519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:35.810284 16519 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:52:35.810328 16519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:35.810341 16519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:35.810362 16519 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:52:35.810388 16519 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:52:35.811918 16519 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.28.213.148:39699/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:38433
--ranger_config_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:38433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=43279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:35.812129 16519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:35.812325 16519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:35.816936 16531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:35.816932 16536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:35.816979 16534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:35.817163 16519 server_base.cc:1034] running on GCE node
I20260808 17:52:35.817412 16519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:35.817672 16519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:35.818812 16519 hybrid_clock.cc:648] HybridClock initialized: now 1786211555818794 us; error 36 us; skew 500 ppm
Aug 08 17:52:35 dist-test-slave-bndk krb5kdc[15036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211555, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:35.821007 16519 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:52:35.821445 16519 webserver.cc:460] Webserver started at http://127.28.213.190:43279/ using document root <none> and password file <none>
I20260808 17:52:35.821623 16519 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:35.821674 16519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 17:52:35 dist-test-slave-bndk krb5kdc[15036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211555, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for HTTP/127.28.213.148@KRBTEST.COM
I20260808 17:52:35.891901 16519 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:52:35.892701 16548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:35.892872 16519 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:52:35.892979 16519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "2778cb57ed414779a0cf489d47cae679"
format_stamp: "Formatted at 2026-08-08 17:52:34 on dist-test-slave-bndk"
server_key: "b2c02fe358a0cef4833bbcedee451036"
server_key_iv: "b90eed899f7f57e41695fb940cf6c0ea"
server_key_version: "kuduclusterkey@0"
I20260808 17:52:35.893491 16519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:35.907042 16519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:35.909298 16519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:35.909461 16519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:35.913463 16519 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:38433
I20260808 17:52:35.913494 16660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:38433 every 8 connection(s)
I20260808 17:52:35.913874 16519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:52:35.915040 16661 sys_catalog.cc:263] Verifying existing consensus state
I20260808 17:52:35.915645 16661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679: Bootstrap starting.
I20260808 17:52:35.923138 16661 log.cc:824] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679: Log is configured to *not* fsync() on all Append() calls
I20260808 17:52:35.923902 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 16519
I20260808 17:52:35.924216 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.213.148:39699/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:41183
--local_ip_for_outbound_sockets=127.28.213.129
--tserver_master_addrs=127.28.213.190:38433
--webserver_port=45379
--webserver_interface=127.28.213.129
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.28.213.148:39699/kms with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:52:35.925109 16661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:52:35.925400 16661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679: Bootstrap complete.
I20260808 17:52:35.927680 16661 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2778cb57ed414779a0cf489d47cae679" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38433 } }
I20260808 17:52:35.927904 16661 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2778cb57ed414779a0cf489d47cae679, State: Initialized, Role: FOLLOWER
I20260808 17:52:35.928040 16661 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2778cb57ed414779a0cf489d47cae679" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38433 } }
I20260808 17:52:35.928102 16661 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:52:35.928133 16661 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:52:35.928175 16661 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [term 1 FOLLOWER]: Advancing to term 2
I20260808 17:52:35.929112 16661 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2778cb57ed414779a0cf489d47cae679" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38433 } }
I20260808 17:52:35.929201 16661 leader_election.cc:302] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2778cb57ed414779a0cf489d47cae679; no voters:
I20260808 17:52:35.929386 16661 leader_election.cc:288] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 17:52:35.929438 16667 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 17:52:35.929550 16667 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [term 2 LEADER]: Becoming Leader. State: Replica: 2778cb57ed414779a0cf489d47cae679, State: Running, Role: LEADER
I20260808 17:52:35.929651 16661 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:52:35.929641 16667 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2778cb57ed414779a0cf489d47cae679" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38433 } }
I20260808 17:52:35.930114 16670 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2778cb57ed414779a0cf489d47cae679" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2778cb57ed414779a0cf489d47cae679" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38433 } } }
I20260808 17:52:35.930202 16670 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [sys.catalog]: This master's current role is: LEADER
I20260808 17:52:35.930334 16669 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2778cb57ed414779a0cf489d47cae679. Latest consensus state: current_term: 2 leader_uuid: "2778cb57ed414779a0cf489d47cae679" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2778cb57ed414779a0cf489d47cae679" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38433 } } }
I20260808 17:52:35.930390 16669 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679 [sys.catalog]: This master's current role is: LEADER
I20260808 17:52:35.930481 16678 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:52:35.930974 16678 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:52:35.931308 16661 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 17:52:35.931572 16678 catalog_manager.cc:1259] Loaded cluster ID: 5e2a325ae5aa4c049788fdf72ae48952
I20260808 17:52:35.931620 16678 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:52:35.934995 16678 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:52:35.935292 16678 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679: Loaded TSK: 0
I20260808 17:52:35.935524 16678 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 17:52:36.039858 16666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:36.040135 16666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:36.040175 16666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:36.041812 16666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:36.041875 16666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:36.041913 16666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:52:36.043978 16666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.28.213.148:39699/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:41183
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=45379
--tserver_master_addrs=127.28.213.190:38433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:36.044224 16666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:36.044507 16666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:36.051353 16738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:36.051457 16666 server_base.cc:1034] running on GCE node
W20260808 17:52:36.051684 16735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:36.051851 16732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:36.052086 16666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:36.052353 16666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:36.053519 16666 hybrid_clock.cc:648] HybridClock initialized: now 1786211556053492 us; error 39 us; skew 500 ppm
Aug 08 17:52:36 dist-test-slave-bndk krb5kdc[15036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211556, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:36.056682 16666 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:52:36.057173 16666 webserver.cc:460] Webserver started at http://127.28.213.129:45379/ using document root <none> and password file <none>
I20260808 17:52:36.057489 16666 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:36.057578 16666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 17:52:36 dist-test-slave-bndk krb5kdc[15036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211556, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for HTTP/127.28.213.148@KRBTEST.COM
I20260808 17:52:36.071764 16666 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.000s
I20260808 17:52:36.075389 16747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:36.075555 16666 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.000s
I20260808 17:52:36.075644 16666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "108e2c8237f6439b8b748accecb3852c"
format_stamp: "Formatted at 2026-08-08 17:52:35 on dist-test-slave-bndk"
server_key: "813761f46d5584587b452a3c41742b5b"
server_key_iv: "4705c380a02b7235a9ff2c39cc14dbff"
server_key_version: "kuduclusterkey@0"
I20260808 17:52:36.076094 16666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:36.124943 16666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:36.127319 16666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:36.127472 16666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:36.127696 16666 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:52:36.128085 16666 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:52:36.128139 16666 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:36.128176 16666 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:52:36.128194 16666 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:36.135273 16666 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:41183
I20260808 17:52:36.135375 16917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:41183 every 8 connection(s)
I20260808 17:52:36.135705 16666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:52:36.143824 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 16666
I20260808 17:52:36.144134 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.213.148:39699/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:46515
--local_ip_for_outbound_sockets=127.28.213.130
--tserver_master_addrs=127.28.213.190:38433
--webserver_port=40087
--webserver_interface=127.28.213.130
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.28.213.148:39699/kms with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 17:52:36 dist-test-slave-bndk krb5kdc[15036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211556, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:52:36.151180 16922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:36.136466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38433 (local address 127.28.213.129:41437)
0808 17:52:36.136883 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:36.136928 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:36.137579 (+ 651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:36.138124 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:36.138129 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:36.138342 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:36.138617 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:36.138624 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:36.142960 (+ 4336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:36.142961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:36.144214 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:36.144217 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:36.145157 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:36.145158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:36.145314 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:36.145791 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:36.145801 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:36.147296 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:36.149386 (+ 2090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:36.149393 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:36.149396 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:36.149687 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:36.149964 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:36.149965 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:36.149965 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:36.150090 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:36.150562 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:36.150568 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:36.150713 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 17:52:36.150813 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 17:52:36.150957 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":84,"threads_started":1}
I20260808 17:52:36.151800 16923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:36.136569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:41437 (local address 127.28.213.190:38433)
0808 17:52:36.136792 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:36.136802 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:36.137061 (+ 259us) server_negotiation.cc:407] Connection header received
0808 17:52:36.137847 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:36.137855 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:36.137916 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:36.138067 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:36.138750 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:36.142841 (+ 4091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:36.144314 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:36.144943 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:36.145049 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:36.147419 (+ 2370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:36.147423 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:36.147424 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:36.147436 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:36.149299 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:36.149779 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:36.149783 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:36.149783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:36.149888 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:36.150160 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:36.150161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:36.150161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:36.150454 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:36.150532 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:36.151485 (+ 953us) server_negotiation.cc:299] Negotiation successful
0808 17:52:36.151604 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":91,"threads_started":1}
I20260808 17:52:36.152387 16918 heartbeater.cc:347] Connected to a master server at 127.28.213.190:38433
I20260808 17:52:36.152495 16918 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:36.152678 16918 heartbeater.cc:511] Master 127.28.213.190:38433 requested a full tablet report, sending...
W20260808 17:52:36.153498 16918 heartbeater.cc:644] Failed to heartbeat to 127.28.213.190:38433 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 17:52:36.153568 16918 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:36.153623 16918 heartbeater.cc:511] Master 127.28.213.190:38433 requested a full tablet report, sending...
I20260808 17:52:36.153893 16918 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:36.153964 16918 heartbeater.cc:511] Master 127.28.213.190:38433 requested a full tablet report, sending...
W20260808 17:52:36.154212 16918 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 17:52:36.248665 16926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:36.248919 16926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:36.248958 16926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:36.250101 16926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:36.250139 16926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:36.250164 16926 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:52:36.251828 16926 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.28.213.148:39699/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:46515
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=40087
--tserver_master_addrs=127.28.213.190:38433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:36.252040 16926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:36.252246 16926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:36.258198 16936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:36.258471 16933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:36.258595 16934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:36.258848 16926 server_base.cc:1034] running on GCE node
I20260808 17:52:36.259048 16926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:36.259357 16926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:36.260537 16926 hybrid_clock.cc:648] HybridClock initialized: now 1786211556260517 us; error 33 us; skew 500 ppm
Aug 08 17:52:36 dist-test-slave-bndk krb5kdc[15036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211556, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:36.263670 16926 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:52:36.264232 16926 webserver.cc:460] Webserver started at http://127.28.213.130:40087/ using document root <none> and password file <none>
I20260808 17:52:36.264482 16926 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:36.264568 16926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 17:52:36 dist-test-slave-bndk krb5kdc[15036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211556, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for HTTP/127.28.213.148@KRBTEST.COM
I20260808 17:52:36.278832 16926 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:52:36.283974 16949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:36.284144 16926 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.000s sys 0.000s
I20260808 17:52:36.284225 16926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "85a6572bd01942fda6897dd629591390"
format_stamp: "Formatted at 2026-08-08 17:52:35 on dist-test-slave-bndk"
server_key: "6d813997ff049cdc49a14e9568ded1eb"
server_key_iv: "2417418ec123a29378c58042401e04f6"
server_key_version: "kuduclusterkey@0"
I20260808 17:52:36.284560 16926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:36.307561 16926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:36.309477 16926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:36.309633 16926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:36.309859 16926 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:52:36.310226 16926 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:52:36.310276 16926 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:36.310308 16926 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:52:36.310326 16926 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:36.316632 16926 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:46515
I20260808 17:52:36.317116 16926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:52:36.318318 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 16926
I20260808 17:52:36.318624 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.213.148:39699/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:46453
--local_ip_for_outbound_sockets=127.28.213.131
--tserver_master_addrs=127.28.213.190:38433
--webserver_port=38749
--webserver_interface=127.28.213.131
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.28.213.148:39699/kms with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:52:36.319784 17117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:46515 every 8 connection(s)
Aug 08 17:52:36 dist-test-slave-bndk krb5kdc[15036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211556, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:52:36.341408 16923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:36.321317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:58355 (local address 127.28.213.190:38433)
0808 17:52:36.321363 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:36.321365 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:36.321556 (+ 191us) server_negotiation.cc:407] Connection header received
0808 17:52:36.322219 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:36.322221 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:36.322235 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:36.322263 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:36.323047 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:36.323818 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:36.325309 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:36.325615 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:36.325661 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:36.328090 (+ 2429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:36.328092 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:36.328092 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:36.328099 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:36.329759 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:36.340029 (+ 10270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:36.340030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:36.340031 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:36.340101 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:36.340545 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:36.340546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:36.340547 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:36.340697 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:36.340748 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:36.341091 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 17:52:36.341186 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:52:36.342180 17122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:36.321018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38433 (local address 127.28.213.130:58355)
0808 17:52:36.321426 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:36.321474 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:36.322097 (+ 623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:36.322453 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:36.322457 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:36.322677 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:36.322939 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:36.322946 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:36.323939 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:36.323940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:36.325175 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:36.325178 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:36.325773 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:36.325774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:36.325920 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:36.326483 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:36.326494 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:36.327978 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:36.339490 (+ 11512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:36.339499 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:36.339501 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:36.339871 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:36.340181 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:36.340181 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:36.340182 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:36.340439 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:36.340780 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:36.340786 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:36.340945 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 17:52:36.341763 (+ 818us) client_negotiation.cc:240] Negotiation successful
0808 17:52:36.341958 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":77,"threads_started":1}
I20260808 17:52:36.342839 17118 heartbeater.cc:347] Connected to a master server at 127.28.213.190:38433
I20260808 17:52:36.342929 17118 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:36.343099 17118 heartbeater.cc:511] Master 127.28.213.190:38433 requested a full tablet report, sending...
W20260808 17:52:36.343719 17118 heartbeater.cc:644] Failed to heartbeat to 127.28.213.190:38433 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 17:52:36.343782 17118 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:36.343835 17118 heartbeater.cc:511] Master 127.28.213.190:38433 requested a full tablet report, sending...
I20260808 17:52:36.344139 17118 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:36.344203 17118 heartbeater.cc:511] Master 127.28.213.190:38433 requested a full tablet report, sending...
W20260808 17:52:36.344497 17118 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 17:52:36.422356 17121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:36.422542 17121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:36.422574 17121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:36.423696 17121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:36.423740 17121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:36.423774 17121 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:52:36.425186 17121 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.28.213.148:39699/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:46453
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=38749
--tserver_master_addrs=127.28.213.190:38433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17121
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:36.425433 17121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:36.425647 17121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:36.430272 17132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:36.430341 17137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:36.431126 17121 server_base.cc:1034] running on GCE node
W20260808 17:52:36.431124 17134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:36.431469 17121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:36.431701 17121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:36.435015 17121 hybrid_clock.cc:648] HybridClock initialized: now 1786211556434955 us; error 67 us; skew 500 ppm
Aug 08 17:52:36 dist-test-slave-bndk krb5kdc[15036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211556, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:36.438102 17121 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:52:36.438589 17121 webserver.cc:460] Webserver started at http://127.28.213.131:38749/ using document root <none> and password file <none>
I20260808 17:52:36.438848 17121 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:36.438922 17121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 17:52:36 dist-test-slave-bndk krb5kdc[15036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211556, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for HTTP/127.28.213.148@KRBTEST.COM
I20260808 17:52:36.451994 17121 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:52:36.452901 17149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:36.453038 17121 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 17:52:36.453107 17121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "e91003c4b3c74618bd89073a86e61852"
format_stamp: "Formatted at 2026-08-08 17:52:35 on dist-test-slave-bndk"
server_key: "9d6a60512dd1387242e9794803236c62"
server_key_iv: "b392f5cc5ff7a4e51b9d7a68440ce9d1"
server_key_version: "kuduclusterkey@0"
I20260808 17:52:36.453573 17121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:36.466002 17121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:36.467726 17121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:36.467859 17121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:36.468039 17121 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:52:36.468369 17121 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:52:36.468405 17121 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:36.468433 17121 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:52:36.468457 17121 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:36.475080 17121 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:46453
I20260808 17:52:36.475466 17121 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:52:36.476011 17326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:46453 every 8 connection(s)
Aug 08 17:52:36 dist-test-slave-bndk krb5kdc[15036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211556, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:52:36.481594 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 17121
I20260808 17:52:36.484405 16923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:36.476158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:54989 (local address 127.28.213.190:38433)
0808 17:52:36.476204 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:36.476206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:36.476431 (+ 225us) server_negotiation.cc:407] Connection header received
0808 17:52:36.476927 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:36.476929 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:36.476942 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:36.476993 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:36.477585 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:36.478075 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:36.479020 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:36.479218 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:36.479275 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:36.481725 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:36.481727 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:36.481727 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:36.481736 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:36.483125 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:36.483478 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:36.483480 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:36.483481 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:36.483537 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:36.483752 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:36.483753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:36.483754 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:36.483862 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:36.483917 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:36.484226 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 17:52:36.484313 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:52:36.484943 17330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:36.476169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:38433 (local address 127.28.213.131:54989)
0808 17:52:36.476307 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:36.476352 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:36.476828 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:36.477060 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:36.477065 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:36.477252 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:36.477464 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:36.477469 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:36.478159 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:36.478160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:36.478930 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:36.478932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:36.479303 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:36.479305 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:36.479422 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:36.479857 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:36.479865 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:36.481598 (+ 1733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:36.483195 (+ 1597us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:36.483201 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:36.483203 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:36.483411 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:36.483591 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:36.483592 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:36.483592 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:36.483695 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:36.483917 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:36.483924 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:36.484065 (+ 141us) client_negotiation.cc:769] Sending connection context
0808 17:52:36.484557 (+ 492us) client_negotiation.cc:240] Negotiation successful
0808 17:52:36.484712 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":75,"threads_started":1}
I20260808 17:52:36.485404 17328 heartbeater.cc:347] Connected to a master server at 127.28.213.190:38433
I20260808 17:52:36.485499 17328 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:36.485692 17328 heartbeater.cc:511] Master 127.28.213.190:38433 requested a full tablet report, sending...
W20260808 17:52:36.486263 17328 heartbeater.cc:644] Failed to heartbeat to 127.28.213.190:38433 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 17:52:36.486346 17328 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:36.486425 17328 heartbeater.cc:511] Master 127.28.213.190:38433 requested a full tablet report, sending...
I20260808 17:52:36.486713 17328 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:36.486793 17328 heartbeater.cc:511] Master 127.28.213.190:38433 requested a full tablet report, sending...
W20260808 17:52:36.487088 17328 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 17:52:36.491361 17333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:36.482452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35918 (local address 127.28.213.190:38433)
0808 17:52:36.482669 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:36.482671 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:36.482680 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:52:36.482701 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:36.482702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:36.482714 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:36.482788 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:36.485272 (+ 2484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:36.486167 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:36.487516 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:36.487701 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:36.487752 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:36.489057 (+ 1305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:36.489058 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:36.489059 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:36.489066 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:36.490362 (+ 1296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:36.490721 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:36.490722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:36.490722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:36.490767 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:36.490928 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:36.490928 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:36.490928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:36.491014 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:36.491115 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:36.491200 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 17:52:36.491265 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":54,"threads_started":1}
Aug 08 17:52:36 dist-test-slave-bndk krb5kdc[15036](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786211556, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:37.154399 16918 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:37.154559 16918 heartbeater.cc:511] Master 127.28.213.190:38433 requested a full tablet report, sending...
I20260808 17:52:37.154938 16583 ts_manager.cc:194] Registered new tserver with Master: 108e2c8237f6439b8b748accecb3852c (127.28.213.129:41183)
I20260808 17:52:37.155939 16583 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:41437
I20260808 17:52:37.344655 17118 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:37.344815 17118 heartbeater.cc:511] Master 127.28.213.190:38433 requested a full tablet report, sending...
I20260808 17:52:37.345130 16583 ts_manager.cc:194] Registered new tserver with Master: 85a6572bd01942fda6897dd629591390 (127.28.213.130:46515)
I20260808 17:52:37.345685 16583 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:58355
Aug 08 17:52:37 dist-test-slave-bndk krb5kdc[15036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211556, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for HTTP/127.28.213.148@KRBTEST.COM
I20260808 17:52:37.487253 17328 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:37.487397 17328 heartbeater.cc:511] Master 127.28.213.190:38433 requested a full tablet report, sending...
I20260808 17:52:37.487725 16583 ts_manager.cc:194] Registered new tserver with Master: e91003c4b3c74618bd89073a86e61852 (127.28.213.131:46453)
I20260808 17:52:37.488258 16583 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:54989
I20260808 17:52:37.489812 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:52:37.498675 17361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:37.490823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59080 (local address 127.28.213.190:38433)
0808 17:52:37.490944 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:37.490946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:37.491083 (+ 137us) server_negotiation.cc:407] Connection header received
0808 17:52:37.491118 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:37.491119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:37.491133 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:37.491209 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:37.491949 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.492710 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.493795 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.494107 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.494178 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:37.495654 (+ 1476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:37.495656 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:37.495656 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:37.495664 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:37.497512 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:37.497905 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:37.497907 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:37.497907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:37.497976 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:37.498152 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:37.498153 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:37.498153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:37.498270 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:37.498373 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:37.498471 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 17:52:37.498560 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":74,"threads_started":1}
I20260808 17:52:37.500730 16583 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59080:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:52:37.503151 16583 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:52:37.512465 17369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:37.506600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38284 (local address 127.28.213.130:46515)
0808 17:52:37.506884 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:37.506888 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:37.507656 (+ 768us) server_negotiation.cc:407] Connection header received
0808 17:52:37.507751 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:37.507753 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:37.507768 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:37.507832 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:52:37.508293 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.509368 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.510823 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.511822 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.511886 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:37.511946 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:37.512306 (+ 360us) server_negotiation.cc:299] Negotiation successful
0808 17:52:37.512349 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":65,"threads_started":1}
I20260808 17:52:37.512588 17372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:37.506650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42254 (local address 127.28.213.131:46453)
0808 17:52:37.506821 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:37.506826 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:37.507376 (+ 550us) server_negotiation.cc:407] Connection header received
0808 17:52:37.507452 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:37.507455 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:37.507472 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:37.507550 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:52:37.507907 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.508974 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.510812 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.511811 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.511912 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:37.511966 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:37.512430 (+ 464us) server_negotiation.cc:299] Negotiation successful
0808 17:52:37.512474 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":50,"threads_started":1}
I20260808 17:52:37.512933 17368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:37.506275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:46453 (local address 127.0.0.1:42254)
0808 17:52:37.507248 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:37.507301 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:37.507379 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:37.507751 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:37.507754 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:37.507757 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:52:37.507821 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:37.507823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.509352 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.509352 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:37.510715 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:37.510718 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.512256 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.512256 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:37.512341 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:37.512344 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:52:37.512760 (+ 416us) client_negotiation.cc:240] Negotiation successful
0808 17:52:37.512826 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":911,"mutex_wait_us":34,"thread_start_us":718,"threads_started":1}
I20260808 17:52:37.513195 17373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:37.506408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:46515 (local address 127.0.0.1:38284)
0808 17:52:37.507606 (+ 1198us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:37.507613 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:37.507679 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:37.508020 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:37.508021 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:37.508023 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:52:37.508191 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:37.508193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.509468 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.509469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:37.510720 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:37.510723 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.512011 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.512012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:37.512154 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:37.512174 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 17:52:37.512810 (+ 636us) client_negotiation.cc:240] Negotiation successful
0808 17:52:37.512868 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1185,"mutex_wait_us":1,"thread_start_us":129,"threads_started":1}
I20260808 17:52:37.513888 17223 tablet_service.cc:1467] Processing CreateTablet for tablet 27ebee1e150c4a70bfe126a707354985 (DEFAULT_TABLE table=test-table [id=7863e9b95eb0423fadc075f1acfe809d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:52:37.514268 17223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27ebee1e150c4a70bfe126a707354985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:52:37.514221 17021 tablet_service.cc:1467] Processing CreateTablet for tablet 27ebee1e150c4a70bfe126a707354985 (DEFAULT_TABLE table=test-table [id=7863e9b95eb0423fadc075f1acfe809d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:52:37.514551 17021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27ebee1e150c4a70bfe126a707354985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:52:37.518854 17377 tablet_bootstrap.cc:492] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390: Bootstrap starting.
I20260808 17:52:37.519997 17377 tablet_bootstrap.cc:654] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390: Neither blocks nor log segments found. Creating new log.
I20260808 17:52:37.520731 17377 log.cc:824] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390: Log is configured to *not* fsync() on all Append() calls
I20260808 17:52:37.521782 17377 tablet_bootstrap.cc:492] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390: No bootstrap required, opened a new log
I20260808 17:52:37.521859 17377 ts_tablet_manager.cc:1397] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:52:37.523099 17376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:37.506283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:41183 (local address 127.0.0.1:52996)
0808 17:52:37.507487 (+ 1204us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:37.507496 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:37.507537 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:37.519350 (+ 11813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:37.519351 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:37.519353 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:52:37.519396 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:37.519398 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.520225 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.520226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:37.521420 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:37.521423 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.522897 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.522898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:37.522964 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:37.522969 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:52:37.522995 (+ 26us) client_negotiation.cc:240] Negotiation successful
0808 17:52:37.523031 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1188,"thread_start_us":803,"threads_started":1}
I20260808 17:52:37.523525 17367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:37.506372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52996 (local address 127.28.213.129:41183)
0808 17:52:37.519174 (+ 12802us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:37.519179 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:37.519189 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:52:37.519224 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:37.519226 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:37.519243 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:37.519350 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:52:37.519493 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.520148 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.521516 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.522802 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.523248 (+ 446us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:37.523346 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:37.523372 (+ 26us) server_negotiation.cc:299] Negotiation successful
0808 17:52:37.523411 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12762,"thread_start_us":55,"threads_started":1}
I20260808 17:52:37.524221 16814 tablet_service.cc:1467] Processing CreateTablet for tablet 27ebee1e150c4a70bfe126a707354985 (DEFAULT_TABLE table=test-table [id=7863e9b95eb0423fadc075f1acfe809d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:52:37.524634 16814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27ebee1e150c4a70bfe126a707354985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:52:37.525846 17377 raft_consensus.cc:348] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91003c4b3c74618bd89073a86e61852" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 46453 } } peers { permanent_uuid: "108e2c8237f6439b8b748accecb3852c" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 41183 } } peers { permanent_uuid: "85a6572bd01942fda6897dd629591390" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 46515 } }
I20260808 17:52:37.525998 17377 raft_consensus.cc:374] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:52:37.526029 17377 raft_consensus.cc:729] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85a6572bd01942fda6897dd629591390, State: Initialized, Role: FOLLOWER
I20260808 17:52:37.526474 17377 consensus_queue.cc:260] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91003c4b3c74618bd89073a86e61852" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 46453 } } peers { permanent_uuid: "108e2c8237f6439b8b748accecb3852c" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 41183 } } peers { permanent_uuid: "85a6572bd01942fda6897dd629591390" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 46515 } }
I20260808 17:52:37.526903 17377 ts_tablet_manager.cc:1428] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
I20260808 17:52:37.527072 17118 heartbeater.cc:503] Master 127.28.213.190:38433 was elected leader, sending a full tablet report...
I20260808 17:52:37.528481 17378 tablet_bootstrap.cc:492] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852: Bootstrap starting.
I20260808 17:52:37.529209 17382 tablet_bootstrap.cc:492] T 27ebee1e150c4a70bfe126a707354985 P 108e2c8237f6439b8b748accecb3852c: Bootstrap starting.
I20260808 17:52:37.529810 17378 tablet_bootstrap.cc:654] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852: Neither blocks nor log segments found. Creating new log.
I20260808 17:52:37.530264 17382 tablet_bootstrap.cc:654] T 27ebee1e150c4a70bfe126a707354985 P 108e2c8237f6439b8b748accecb3852c: Neither blocks nor log segments found. Creating new log.
I20260808 17:52:37.530705 17378 log.cc:824] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852: Log is configured to *not* fsync() on all Append() calls
I20260808 17:52:37.531069 17382 log.cc:824] T 27ebee1e150c4a70bfe126a707354985 P 108e2c8237f6439b8b748accecb3852c: Log is configured to *not* fsync() on all Append() calls
I20260808 17:52:37.531661 17378 tablet_bootstrap.cc:492] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852: No bootstrap required, opened a new log
I20260808 17:52:37.531733 17378 ts_tablet_manager.cc:1397] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20260808 17:52:37.535503 17378 raft_consensus.cc:348] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91003c4b3c74618bd89073a86e61852" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 46453 } } peers { permanent_uuid: "108e2c8237f6439b8b748accecb3852c" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 41183 } } peers { permanent_uuid: "85a6572bd01942fda6897dd629591390" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 46515 } }
I20260808 17:52:37.535661 17378 raft_consensus.cc:374] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:52:37.535691 17378 raft_consensus.cc:729] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e91003c4b3c74618bd89073a86e61852, State: Initialized, Role: FOLLOWER
I20260808 17:52:37.535826 17378 consensus_queue.cc:260] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91003c4b3c74618bd89073a86e61852" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 46453 } } peers { permanent_uuid: "108e2c8237f6439b8b748accecb3852c" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 41183 } } peers { permanent_uuid: "85a6572bd01942fda6897dd629591390" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 46515 } }
I20260808 17:52:37.536123 17378 ts_tablet_manager.cc:1428] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852: Time spent starting tablet: real 0.004s user 0.004s sys 0.001s
I20260808 17:52:37.536242 17328 heartbeater.cc:503] Master 127.28.213.190:38433 was elected leader, sending a full tablet report...
I20260808 17:52:37.537149 17382 tablet_bootstrap.cc:492] T 27ebee1e150c4a70bfe126a707354985 P 108e2c8237f6439b8b748accecb3852c: No bootstrap required, opened a new log
I20260808 17:52:37.537285 17382 ts_tablet_manager.cc:1397] T 27ebee1e150c4a70bfe126a707354985 P 108e2c8237f6439b8b748accecb3852c: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260808 17:52:37.540968 17382 raft_consensus.cc:348] T 27ebee1e150c4a70bfe126a707354985 P 108e2c8237f6439b8b748accecb3852c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91003c4b3c74618bd89073a86e61852" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 46453 } } peers { permanent_uuid: "108e2c8237f6439b8b748accecb3852c" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 41183 } } peers { permanent_uuid: "85a6572bd01942fda6897dd629591390" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 46515 } }
I20260808 17:52:37.541129 17382 raft_consensus.cc:374] T 27ebee1e150c4a70bfe126a707354985 P 108e2c8237f6439b8b748accecb3852c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:52:37.541169 17382 raft_consensus.cc:729] T 27ebee1e150c4a70bfe126a707354985 P 108e2c8237f6439b8b748accecb3852c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 108e2c8237f6439b8b748accecb3852c, State: Initialized, Role: FOLLOWER
I20260808 17:52:37.541357 17382 consensus_queue.cc:260] T 27ebee1e150c4a70bfe126a707354985 P 108e2c8237f6439b8b748accecb3852c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91003c4b3c74618bd89073a86e61852" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 46453 } } peers { permanent_uuid: "108e2c8237f6439b8b748accecb3852c" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 41183 } } peers { permanent_uuid: "85a6572bd01942fda6897dd629591390" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 46515 } }
I20260808 17:52:37.541702 17382 ts_tablet_manager.cc:1428] T 27ebee1e150c4a70bfe126a707354985 P 108e2c8237f6439b8b748accecb3852c: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260808 17:52:37.541745 16918 heartbeater.cc:503] Master 127.28.213.190:38433 was elected leader, sending a full tablet report...
W20260808 17:52:37.571421 17119 tablet.cc:2369] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:52:37.614650 17380 raft_consensus.cc:482] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:52:37.614794 17380 raft_consensus.cc:504] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91003c4b3c74618bd89073a86e61852" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 46453 } } peers { permanent_uuid: "108e2c8237f6439b8b748accecb3852c" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 41183 } } peers { permanent_uuid: "85a6572bd01942fda6897dd629591390" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 46515 } }
I20260808 17:52:37.615262 17380 leader_election.cc:288] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e91003c4b3c74618bd89073a86e61852 (127.28.213.131:46453), 108e2c8237f6439b8b748accecb3852c (127.28.213.129:41183)
I20260808 17:52:37.619771 17372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:37.615773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:53943 (local address 127.28.213.131:46453)
0808 17:52:37.615821 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:37.615824 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:37.615996 (+ 172us) server_negotiation.cc:407] Connection header received
0808 17:52:37.616026 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:37.616027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:37.616037 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:37.616107 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:52:37.616468 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.617184 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.618802 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.619326 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.619371 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:37.619380 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:37.619663 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 17:52:37.619706 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:52:37.620163 17367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:37.616292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:52939 (local address 127.28.213.129:41183)
0808 17:52:37.616332 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:37.616334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:37.616431 (+ 97us) server_negotiation.cc:407] Connection header received
0808 17:52:37.616522 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:37.616523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:37.616531 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:37.616557 (+ 26us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:52:37.616916 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.617612 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.619099 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.619699 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.619749 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:37.619757 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:37.620045 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 17:52:37.620096 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:52:37.620263 17389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:37.615577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:46453 (local address 127.28.213.130:53943)
0808 17:52:37.615863 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:37.615876 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:37.615942 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:37.616162 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:37.616164 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:37.616166 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:52:37.616377 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:37.616379 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.617319 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.617320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:37.618699 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:37.618702 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.619514 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.619515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:37.619581 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:37.619584 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:52:37.620066 (+ 482us) client_negotiation.cc:240] Negotiation successful
0808 17:52:37.620109 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":127,"threads_started":1}
I20260808 17:52:37.620636 17390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:37.616127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:41183 (local address 127.28.213.130:52939)
0808 17:52:37.616378 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:37.616387 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:37.616453 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:37.616615 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:37.616616 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:37.616618 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:52:37.616818 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:37.616821 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.617712 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.617713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:37.618984 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:37.618987 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.619818 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.619818 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:37.619953 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:37.619957 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:52:37.620514 (+ 557us) client_negotiation.cc:240] Negotiation successful
0808 17:52:37.620557 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"mutex_wait_us":14,"thread_start_us":67,"threads_started":1}
I20260808 17:52:37.620640 17252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27ebee1e150c4a70bfe126a707354985" candidate_uuid: "85a6572bd01942fda6897dd629591390" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e91003c4b3c74618bd89073a86e61852" is_pre_election: true
I20260808 17:52:37.620788 17252 raft_consensus.cc:2454] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85a6572bd01942fda6897dd629591390 in term 0.
I20260808 17:52:37.621093 16950 leader_election.cc:302] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85a6572bd01942fda6897dd629591390, e91003c4b3c74618bd89073a86e61852; no voters:
I20260808 17:52:37.621239 17380 raft_consensus.cc:2781] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:52:37.621279 17380 raft_consensus.cc:482] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:52:37.621297 17380 raft_consensus.cc:3037] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:52:37.621351 16831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27ebee1e150c4a70bfe126a707354985" candidate_uuid: "85a6572bd01942fda6897dd629591390" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "108e2c8237f6439b8b748accecb3852c" is_pre_election: true
I20260808 17:52:37.621500 16831 raft_consensus.cc:2454] T 27ebee1e150c4a70bfe126a707354985 P 108e2c8237f6439b8b748accecb3852c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85a6572bd01942fda6897dd629591390 in term 0.
I20260808 17:52:37.622241 17380 raft_consensus.cc:504] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91003c4b3c74618bd89073a86e61852" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 46453 } } peers { permanent_uuid: "108e2c8237f6439b8b748accecb3852c" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 41183 } } peers { permanent_uuid: "85a6572bd01942fda6897dd629591390" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 46515 } }
I20260808 17:52:37.622375 17380 leader_election.cc:288] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [CANDIDATE]: Term 1 election: Requested vote from peers e91003c4b3c74618bd89073a86e61852 (127.28.213.131:46453), 108e2c8237f6439b8b748accecb3852c (127.28.213.129:41183)
I20260808 17:52:37.622562 16831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27ebee1e150c4a70bfe126a707354985" candidate_uuid: "85a6572bd01942fda6897dd629591390" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "108e2c8237f6439b8b748accecb3852c"
I20260808 17:52:37.622623 17252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27ebee1e150c4a70bfe126a707354985" candidate_uuid: "85a6572bd01942fda6897dd629591390" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e91003c4b3c74618bd89073a86e61852"
I20260808 17:52:37.622642 16831 raft_consensus.cc:3037] T 27ebee1e150c4a70bfe126a707354985 P 108e2c8237f6439b8b748accecb3852c [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:52:37.622690 17252 raft_consensus.cc:3037] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:52:37.623597 17252 raft_consensus.cc:2454] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85a6572bd01942fda6897dd629591390 in term 1.
I20260808 17:52:37.623755 16950 leader_election.cc:302] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85a6572bd01942fda6897dd629591390, e91003c4b3c74618bd89073a86e61852; no voters:
I20260808 17:52:37.623823 17380 raft_consensus.cc:2781] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:52:37.623832 16831 raft_consensus.cc:2454] T 27ebee1e150c4a70bfe126a707354985 P 108e2c8237f6439b8b748accecb3852c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85a6572bd01942fda6897dd629591390 in term 1.
I20260808 17:52:37.623951 17380 raft_consensus.cc:686] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [term 1 LEADER]: Becoming Leader. State: Replica: 85a6572bd01942fda6897dd629591390, State: Running, Role: LEADER
I20260808 17:52:37.624030 17380 consensus_queue.cc:237] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91003c4b3c74618bd89073a86e61852" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 46453 } } peers { permanent_uuid: "108e2c8237f6439b8b748accecb3852c" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 41183 } } peers { permanent_uuid: "85a6572bd01942fda6897dd629591390" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 46515 } }
I20260808 17:52:37.624805 16583 catalog_manager.cc:5495] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85a6572bd01942fda6897dd629591390 (127.28.213.130). New cstate: current_term: 1 leader_uuid: "85a6572bd01942fda6897dd629591390" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91003c4b3c74618bd89073a86e61852" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 46453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "108e2c8237f6439b8b748accecb3852c" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 41183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85a6572bd01942fda6897dd629591390" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 46515 } health_report { overall_health: HEALTHY } } }
I20260808 17:52:37.631940 17369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:37.628847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38286 (local address 127.28.213.130:46515)
0808 17:52:37.628887 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:37.628888 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:37.628897 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:52:37.628966 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:37.628967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:37.628985 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:37.629064 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:52:37.629192 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.629913 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.631062 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:37.631346 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:37.631418 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:37.631602 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:52:37.631719 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:52:37.631802 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:37.631850 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 17:52:37.631877 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:52:37.634184 17252 raft_consensus.cc:1261] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852 [term 1 FOLLOWER]: Refusing update from remote peer 85a6572bd01942fda6897dd629591390: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:52:37.634234 16831 raft_consensus.cc:1261] T 27ebee1e150c4a70bfe126a707354985 P 108e2c8237f6439b8b748accecb3852c [term 1 FOLLOWER]: Refusing update from remote peer 85a6572bd01942fda6897dd629591390: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:52:37.634579 17392 consensus_queue.cc:1035] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [LEADER]: Connected to new peer: Peer: permanent_uuid: "108e2c8237f6439b8b748accecb3852c" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 41183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:52:37.634749 17380 consensus_queue.cc:1035] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e91003c4b3c74618bd89073a86e61852" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 46453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 17:52:37.637168 16921 tablet.cc:2369] T 27ebee1e150c4a70bfe126a707354985 P 108e2c8237f6439b8b748accecb3852c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:52:37.638607 17401 mvcc.cc:205] Tried to move back new op lower bound from 7316322540067065856 to 7316322540028547072. Current Snapshot: MvccSnapshot[applied={T|T < 7316322540067065856}]
I20260808 17:52:37.640255 17405 mvcc.cc:205] Tried to move back new op lower bound from 7316322540067065856 to 7316322540028547072. Current Snapshot: MvccSnapshot[applied={T|T < 7316322540067065856 or (T in {7316322540067065856})}]
I20260808 17:52:37.641309 17403 mvcc.cc:205] Tried to move back new op lower bound from 7316322540067065856 to 7316322540028547072. Current Snapshot: MvccSnapshot[applied={T|T < 7316322540067065856}]
I20260808 17:52:37.643496 16583 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:52:37.643577 16583 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:52:37.644273 16583 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2778cb57ed414779a0cf489d47cae679: Sending DeleteTablet for 3 replicas of tablet 27ebee1e150c4a70bfe126a707354985
I20260808 17:52:37.644773 17021 tablet_service.cc:1514] Processing DeleteTablet for tablet 27ebee1e150c4a70bfe126a707354985 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:52:37 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:38284
I20260808 17:52:37.644881 17223 tablet_service.cc:1514] Processing DeleteTablet for tablet 27ebee1e150c4a70bfe126a707354985 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:52:37 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:42254
I20260808 17:52:37.645242 16814 tablet_service.cc:1514] Processing DeleteTablet for tablet 27ebee1e150c4a70bfe126a707354985 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:52:37 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:52996
I20260808 17:52:37.645884 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 16666
I20260808 17:52:37.661324 17417 tablet_replica.cc:330] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852: stopping tablet replica
I20260808 17:52:37.661609 17417 raft_consensus.cc:2229] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:52:37.661818 17417 raft_consensus.cc:2258] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:52:37.662420 17417 ts_tablet_manager.cc:1905] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:52:37.664304 17417 ts_tablet_manager.cc:1918] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:52:37.664438 17417 log.cc:1196] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/27ebee1e150c4a70bfe126a707354985
I20260808 17:52:37.664757 17417 ts_tablet_manager.cc:1939] T 27ebee1e150c4a70bfe126a707354985 P e91003c4b3c74618bd89073a86e61852: Deleting consensus metadata
I20260808 17:52:37.665292 16550 catalog_manager.cc:4841] TS e91003c4b3c74618bd89073a86e61852 (127.28.213.131:46453): tablet 27ebee1e150c4a70bfe126a707354985 (table test-table [id=7863e9b95eb0423fadc075f1acfe809d]) successfully deleted
I20260808 17:52:37.666179 17415 tablet_replica.cc:330] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390: stopping tablet replica
I20260808 17:52:37.666357 17415 raft_consensus.cc:2229] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:52:37.666530 17415 raft_consensus.cc:2258] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 17:52:37.666772 16556 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.213.129:41183 (error 108)
I20260808 17:52:37.667361 17415 ts_tablet_manager.cc:1905] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:52:37.668989 17415 ts_tablet_manager.cc:1918] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:52:37.669127 17415 log.cc:1196] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/27ebee1e150c4a70bfe126a707354985
I20260808 17:52:37.669494 17415 ts_tablet_manager.cc:1939] T 27ebee1e150c4a70bfe126a707354985 P 85a6572bd01942fda6897dd629591390: Deleting consensus metadata
I20260808 17:52:37.669920 16552 catalog_manager.cc:4841] TS 85a6572bd01942fda6897dd629591390 (127.28.213.130:46515): tablet 27ebee1e150c4a70bfe126a707354985 (table test-table [id=7863e9b95eb0423fadc075f1acfe809d]) successfully deleted
I20260808 17:52:37.670444 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 16926
I20260808 17:52:37.672714 17376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:37.672606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:41183 (local address 127.0.0.1:53006)
0808 17:52:37.672650 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:37.672681 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.129:41183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 17:52:37.672884 16556 catalog_manager.cc:4584] TS 108e2c8237f6439b8b748accecb3852c (127.28.213.129:41183): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 27ebee1e150c4a70bfe126a707354985: Network error: Client connection negotiation failed: client connection to 127.28.213.129:41183: connect: Connection refused (error 111)
I20260808 17:52:37.679239 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 17121
I20260808 17:52:37.686758 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 16519
I20260808 17:52:37.700817 29526 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 17:52:38.044257 29526 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 17:52:38.044344 29526 mini_ranger.cc:66] Stopping Ranger...
I20260808 17:52:38.388010 29526 mini_ranger.cc:68] Stopped Ranger
2026-08-08 17:52:38.388 UTC [15079] LOG: received smart shutdown request
2026-08-08 17:52:38.392 UTC [15079] LOG: background worker "logical replication launcher" (PID 15092) exited with exit code 1
2026-08-08 17:52:38.392 UTC [15086] LOG: shutting down
2026-08-08 17:52:38.526 UTC [15079] LOG: database system is shut down
2026-08-08T17:52:38Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (45178 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:52:38 dist-test-slave-bndk krb5kdc[17437](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:52:38 dist-test-slave-bndk krb5kdc[17437](info): set up 2 sockets
Aug 08 17:52:38 dist-test-slave-bndk krb5kdc[17437](info): commencing operation
krb5kdc: starting...
W20260808 17:52:39.734294 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:52:39 dist-test-slave-bndk krb5kdc[17437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:52:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:52:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:52:39.843506 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:41169
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:38381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:41169,127.28.213.189:44423,127.28.213.188:46131
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:52:39.921872 17459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:39.922065 17459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:39.922086 17459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:39.923343 17459 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:52:39.923382 17459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:39.923396 17459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:39.923408 17459 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:52:39.923418 17459 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:52:39.924842 17459 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:38381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:41169,127.28.213.189:44423,127.28.213.188:46131
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:41169
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:39.925072 17459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:39.925298 17459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:39.929692 17467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:39.929868 17459 server_base.cc:1034] running on GCE node
W20260808 17:52:39.929723 17475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:39.929692 17470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:39.930239 17459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:39.930495 17459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:39.931622 17459 hybrid_clock.cc:648] HybridClock initialized: now 1786211559931613 us; error 28 us; skew 500 ppm
Aug 08 17:52:39 dist-test-slave-bndk krb5kdc[17437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211559, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:39.936180 17459 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:52:39.936575 17459 webserver.cc:460] Webserver started at http://127.28.213.190:45845/ using document root <none> and password file <none>
I20260808 17:52:39.936769 17459 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:39.936815 17459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:39.936954 17459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:52:39.937953 17459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "6ac3b58a654d4f558400170f7ffbeb44"
format_stamp: "Formatted at 2026-08-08 17:52:39 on dist-test-slave-bndk"
server_key: "8389b1fdd14fa0a1243f7f887b50173b"
server_key_iv: "691a2347e91d0054981eaa6d3226f1d1"
server_key_version: "encryptionkey@0"
I20260808 17:52:39.938273 17459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "6ac3b58a654d4f558400170f7ffbeb44"
format_stamp: "Formatted at 2026-08-08 17:52:39 on dist-test-slave-bndk"
server_key: "8389b1fdd14fa0a1243f7f887b50173b"
server_key_iv: "691a2347e91d0054981eaa6d3226f1d1"
server_key_version: "encryptionkey@0"
I20260808 17:52:39.939427 17459 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:52:39.940035 17488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:39.940179 17459 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:52:39.940249 17459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "6ac3b58a654d4f558400170f7ffbeb44"
format_stamp: "Formatted at 2026-08-08 17:52:39 on dist-test-slave-bndk"
server_key: "8389b1fdd14fa0a1243f7f887b50173b"
server_key_iv: "691a2347e91d0054981eaa6d3226f1d1"
server_key_version: "encryptionkey@0"
I20260808 17:52:39.940306 17459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:39.951803 17459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:39.953339 17459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:39.953462 17459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:39.957088 17459 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:41169
I20260808 17:52:39.957127 17576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:41169 every 8 connection(s)
I20260808 17:52:39.957456 17459 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:52:39.958261 17577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:52:39.959774 17577 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:52:39 dist-test-slave-bndk krb5kdc[17437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211559, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:52:39.967468 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 17459
I20260808 17:52:39.967589 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:52:39.967785 29526 external_mini_cluster.cc:1428] Setting key a9a39bd7fb658a8b0e1555a2517a3d11
I20260808 17:52:39.968415 17580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:39.960346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:41169 (local address 127.0.0.1:55090)
0808 17:52:39.960516 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:39.960555 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:39.961009 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:39.961276 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:39.961278 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:39.961538 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:39.961682 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:39.961686 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:39.962653 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:39.962654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:39.963314 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:39.963316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:39.963797 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:39.963798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:39.963872 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:39.964263 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:39.964271 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:39.965595 (+ 1324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:39.967020 (+ 1425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:39.967027 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:39.967028 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:39.967206 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:39.967397 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:39.967398 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:39.967399 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:39.967506 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:39.967907 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:39.967913 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:39.967976 (+ 63us) client_negotiation.cc:769] Sending connection context
0808 17:52:39.968055 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 17:52:39.968271 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":89,"thread_start_us":81,"threads_started":1}
I20260808 17:52:39.968417 17581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:39.960390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55090 (local address 127.28.213.190:41169)
0808 17:52:39.960523 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:39.960532 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:39.960648 (+ 116us) server_negotiation.cc:407] Connection header received
0808 17:52:39.961155 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:39.961157 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:39.961174 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:39.961269 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:39.961776 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:39.962567 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:39.963393 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:39.963690 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:39.963777 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:39.965688 (+ 1911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:39.965695 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:39.965696 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:39.965702 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:39.966950 (+ 1248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:39.967266 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:39.967268 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:39.967268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:39.967340 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:39.967595 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:39.967596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:39.967597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:39.967834 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:39.967925 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:39.968089 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 17:52:39.968200 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":62,"threads_started":1}
I20260808 17:52:39.969537 17577 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:52:39.969832 17580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:39.969715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:44423 (local address 127.0.0.1:47060)
0808 17:52:39.969755 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:39.969808 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.189:44423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260808 17:52:39.969956 17492 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.213.189:44423: connect: Connection refused (error 111)
I20260808 17:52:39.970319 17580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:39.970237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:44423 (local address 127.0.0.1:47076)
0808 17:52:39.970275 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:39.970302 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.189:44423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 17:52:39.970417 17577 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.189:44423: Network error: Client connection negotiation failed: client connection to 127.28.213.189:44423: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.28.213.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.189.keytab.
Entry for principal kudu/127.28.213.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.189.keytab.
I20260808 17:52:39.990026 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.189:44423
--webserver_interface=127.28.213.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.189.keytab
--principal=kudu/127.28.213.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:38381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:41169,127.28.213.189:44423,127.28.213.188:46131
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:52:40.019641 17577 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } attempt: 1
I20260808 17:52:40.020138 17580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.019979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:44423 (local address 127.0.0.1:47088)
0808 17:52:40.020046 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.020096 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.189:44423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 17:52:40.020507 17580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.020415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:44423 (local address 127.0.0.1:47090)
0808 17:52:40.020458 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.020486 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.189:44423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 17:52:40.020603 17577 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.189:44423: Network error: Client connection negotiation failed: client connection to 127.28.213.189:44423: connect: Connection refused (error 111)
W20260808 17:52:40.069553 17585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:40.069742 17585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:40.069762 17585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:40.070839 17585 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:52:40.070880 17585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:40.070894 17585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:40.070925 17585 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:52:40.070947 17585 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:52:40.072398 17585 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:38381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:41169,127.28.213.189:44423,127.28.213.188:46131
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.189.keytab
--principal=kudu/127.28.213.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.189:44423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.28.213.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:40.072616 17585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:40.072813 17585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:40.077148 17590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:40.077164 17601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:40.077296 17585 server_base.cc:1034] running on GCE node
W20260808 17:52:40.077243 17593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:40.077610 17585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:40.077858 17585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:40.078990 17585 hybrid_clock.cc:648] HybridClock initialized: now 1786211560078979 us; error 26 us; skew 500 ppm
Aug 08 17:52:40 dist-test-slave-bndk krb5kdc[17437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211560, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:40.081279 17585 init.cc:377] Logged in from keytab as kudu/127.28.213.189@KRBTEST.COM (short username kudu)
I20260808 17:52:40.081662 17585 webserver.cc:460] Webserver started at http://127.28.213.189:39497/ using document root <none> and password file <none>
I20260808 17:52:40.081846 17585 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:40.081892 17585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:40.082010 17585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:52:40.082958 17585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-1/data/instance:
uuid: "17db9cb7c1ce4129b084a112875c30f3"
format_stamp: "Formatted at 2026-08-08 17:52:40 on dist-test-slave-bndk"
server_key: "462308f1210e5251f4c5951f2b671f67"
server_key_iv: "3399ca5fea29049222a8634ba2abd199"
server_key_version: "encryptionkey@0"
I20260808 17:52:40.083274 17585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-1/wal/instance:
uuid: "17db9cb7c1ce4129b084a112875c30f3"
format_stamp: "Formatted at 2026-08-08 17:52:40 on dist-test-slave-bndk"
server_key: "462308f1210e5251f4c5951f2b671f67"
server_key_iv: "3399ca5fea29049222a8634ba2abd199"
server_key_version: "encryptionkey@0"
I20260808 17:52:40.084492 17585 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:52:40.085103 17612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:40.085273 17585 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:52:40.085354 17585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-1/wal
uuid: "17db9cb7c1ce4129b084a112875c30f3"
format_stamp: "Formatted at 2026-08-08 17:52:40 on dist-test-slave-bndk"
server_key: "462308f1210e5251f4c5951f2b671f67"
server_key_iv: "3399ca5fea29049222a8634ba2abd199"
server_key_version: "encryptionkey@0"
I20260808 17:52:40.085428 17585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:40.088750 17577 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } attempt: 2
I20260808 17:52:40.089100 17580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.088986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:44423 (local address 127.0.0.1:47104)
0808 17:52:40.089037 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.089072 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.189:44423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 17:52:40.089412 17580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.089325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:44423 (local address 127.0.0.1:47108)
0808 17:52:40.089367 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.089388 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.189:44423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 17:52:40.089491 17577 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.189:44423: Network error: Client connection negotiation failed: client connection to 127.28.213.189:44423: connect: Connection refused (error 111)
I20260808 17:52:40.114763 17585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:40.116349 17585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:40.116466 17585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:40.120127 17585 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.189:44423
I20260808 17:52:40.120169 17702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.189:44423 every 8 connection(s)
I20260808 17:52:40.120476 17585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-1/data/info.pb
I20260808 17:52:40.121292 17704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:52:40.122737 17704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:52:40.124280 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 17585
I20260808 17:52:40.124382 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-1/wal/instance
I20260808 17:52:40.124557 29526 external_mini_cluster.cc:1428] Setting key 6c0922db0b24787bdeefbf35014d354d
Aug 08 17:52:40 dist-test-slave-bndk krb5kdc[17437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211560, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.189@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:52:40.131445 17581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.123353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55100 (local address 127.28.213.190:41169)
0808 17:52:40.123415 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:40.123417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:40.123595 (+ 178us) server_negotiation.cc:407] Connection header received
0808 17:52:40.124035 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:40.124036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:40.124048 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:40.124097 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:40.124738 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.125387 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.126318 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.126608 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.126672 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.128612 (+ 1940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:40.128614 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:40.128614 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:40.128622 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:40.130201 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.130573 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.130574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.130575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.130639 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.130841 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.130842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.130842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.130977 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:40.131043 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:40.131255 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 17:52:40.131348 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 17:52:40.131492 17707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.123329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:41169 (local address 127.0.0.1:55100)
0808 17:52:40.123485 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.123521 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:40.123961 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:40.124160 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:40.124163 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:40.124416 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:40.124633 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:40.124638 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.125482 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.125482 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:40.126234 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:40.126236 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.126691 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.126693 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:40.126809 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.127259 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:40.127267 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:40.128523 (+ 1256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:40.130281 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:40.130287 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:40.130289 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:40.130504 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:40.130702 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:40.130702 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:40.130702 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:40.130790 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:40.131037 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:40.131040 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:40.131142 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 17:52:40.131213 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 17:52:40.131335 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":79,"threads_started":1}
I20260808 17:52:40.132051 17704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.28.213.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.188@KRBTEST.COM" created.
Aug 08 17:52:40 dist-test-slave-bndk krb5kdc[17437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211560, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.189@KRBTEST.COM for kudu/127.28.213.189@KRBTEST.COM
I20260808 17:52:40.138993 17707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.132277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:44423 (local address 127.0.0.1:47118)
0808 17:52:40.132324 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.132337 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:40.132378 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:40.132604 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:40.132605 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:40.132734 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:40.132790 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:40.132791 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.133655 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.133656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:40.134132 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:40.134133 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.134588 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.134589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:40.134650 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.134947 (+ 297us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:40.134950 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:40.136591 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:40.138061 (+ 1470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:40.138062 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:40.138062 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:40.138266 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:40.138438 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:40.138438 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:40.138439 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:40.138502 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:40.138772 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:40.138773 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:40.138808 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 17:52:40.138855 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 17:52:40.138933 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 17:52:40.139101 17709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.132330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47118 (local address 127.28.213.189:44423)
0808 17:52:40.132471 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:40.132475 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:40.132494 (+ 19us) server_negotiation.cc:407] Connection header received
0808 17:52:40.132515 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:40.132516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:40.132526 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:40.132584 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:40.132856 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.133561 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.134201 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.134528 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.134590 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.136672 (+ 2082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:40.136679 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:40.136679 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:40.136685 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:40.137981 (+ 1296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.138335 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.138337 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.138337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.138383 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.138555 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.138556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.138556 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.138713 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:40.138791 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:40.138889 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 17:52:40.139010 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":112,"thread_start_us":78,"threads_started":1}
I20260808 17:52:40.139665 17704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:52:40.139981 17707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.139881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:46131 (local address 127.0.0.1:35746)
0808 17:52:40.139922 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.139961 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:46131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 17:52:40.140095 17616 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.213.188:46131: connect: Connection refused (error 111)
I20260808 17:52:40.140458 17707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.140367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:46131 (local address 127.0.0.1:35752)
0808 17:52:40.140411 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.140435 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:46131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 17:52:40.140545 17704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.188:46131: Network error: Client connection negotiation failed: client connection to 127.28.213.188:46131: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.188.keytab.
Entry for principal kudu/127.28.213.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.188.keytab.
I20260808 17:52:40.149451 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.188:46131
--webserver_interface=127.28.213.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.188.keytab
--principal=kudu/127.28.213.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:38381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:41169,127.28.213.189:44423,127.28.213.188:46131
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:52:40.180634 17577 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } attempt: 3
Aug 08 17:52:40 dist-test-slave-bndk krb5kdc[17437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211559, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for kudu/127.28.213.189@KRBTEST.COM
I20260808 17:52:40.187312 17580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.180954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:44423 (local address 127.0.0.1:47124)
0808 17:52:40.181020 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.181031 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:40.181079 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:40.181204 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:40.181205 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:40.181375 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:40.181447 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:40.181449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.182097 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.182098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:40.182610 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:40.182612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.182968 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.182969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:40.183042 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.183444 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:40.183448 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:40.184917 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:40.186351 (+ 1434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:40.186352 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:40.186352 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:40.186581 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:40.186741 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:40.186742 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:40.186742 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:40.186805 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:40.187004 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:40.187004 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:40.187056 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 17:52:40.187121 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 17:52:40.187215 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 17:52:40.187346 17709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.181030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47124 (local address 127.28.213.189:44423)
0808 17:52:40.181095 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:40.181097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:40.181106 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:52:40.181132 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:40.181133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:40.181145 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:40.181194 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:40.181526 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.182021 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.182691 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.182905 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.182962 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.185010 (+ 2048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:40.185012 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:40.185012 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:40.185019 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:40.186271 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.186647 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.186648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.186648 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.186693 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.186856 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.186857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.186857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.186957 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:40.187000 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:40.187204 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 17:52:40.187286 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 17:52:40.187917 17577 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:52:40.188223 17580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.188130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:46131 (local address 127.0.0.1:35758)
0808 17:52:40.188174 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.188203 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:46131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 17:52:40.188529 17580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.188453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:46131 (local address 127.0.0.1:35768)
0808 17:52:40.188487 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.188509 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:46131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 17:52:40.188601 17577 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.188:46131: Network error: Client connection negotiation failed: client connection to 127.28.213.188:46131: connect: Connection refused (error 111)
I20260808 17:52:40.189711 17704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } attempt: 1
I20260808 17:52:40.190099 17707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.189932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:46131 (local address 127.0.0.1:35776)
0808 17:52:40.190036 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.190072 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:46131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260808 17:52:40.190390 17707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.190305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:46131 (local address 127.0.0.1:35792)
0808 17:52:40.190343 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.190367 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:46131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 17:52:40.190474 17704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.188:46131: Network error: Client connection negotiation failed: client connection to 127.28.213.188:46131: connect: Connection refused (error 111)
I20260808 17:52:40.219725 17577 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } attempt: 1
I20260808 17:52:40.220080 17580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.219981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:46131 (local address 127.0.0.1:35804)
0808 17:52:40.220028 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.220055 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:46131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 17:52:40.220422 17580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.220341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:46131 (local address 127.0.0.1:35810)
0808 17:52:40.220381 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.220406 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:46131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 17:52:40.220505 17577 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.188:46131: Network error: Client connection negotiation failed: client connection to 127.28.213.188:46131: connect: Connection refused (error 111)
W20260808 17:52:40.229653 17716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:40.229832 17716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:40.229861 17716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:40.230955 17716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:52:40.230993 17716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:40.231010 17716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:40.231026 17716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:52:40.231051 17716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:52:40.232486 17716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:38381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:41169,127.28.213.189:44423,127.28.213.188:46131
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.188.keytab
--principal=kudu/127.28.213.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.188:46131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.28.213.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:40.232712 17716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:40.232900 17716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:40.237177 17723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:40.237407 17716 server_base.cc:1034] running on GCE node
W20260808 17:52:40.237188 17728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:40.237185 17726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:40.237715 17716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:40.237986 17716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:40.239125 17716 hybrid_clock.cc:648] HybridClock initialized: now 1786211560239109 us; error 26 us; skew 500 ppm
Aug 08 17:52:40 dist-test-slave-bndk krb5kdc[17437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211560, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:40.241382 17716 init.cc:377] Logged in from keytab as kudu/127.28.213.188@KRBTEST.COM (short username kudu)
I20260808 17:52:40.241784 17716 webserver.cc:460] Webserver started at http://127.28.213.188:39385/ using document root <none> and password file <none>
I20260808 17:52:40.241977 17716 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:40.242025 17716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:40.242146 17716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:52:40.243167 17716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-2/data/instance:
uuid: "4382469f94c745a6ac6c3b6aebfe9278"
format_stamp: "Formatted at 2026-08-08 17:52:40 on dist-test-slave-bndk"
server_key: "90b712d0d6eb9b1b4da3820b915a9f20"
server_key_iv: "aeab1d6e92646839177eaae1551ec15b"
server_key_version: "encryptionkey@0"
I20260808 17:52:40.243498 17716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-2/wal/instance:
uuid: "4382469f94c745a6ac6c3b6aebfe9278"
format_stamp: "Formatted at 2026-08-08 17:52:40 on dist-test-slave-bndk"
server_key: "90b712d0d6eb9b1b4da3820b915a9f20"
server_key_iv: "aeab1d6e92646839177eaae1551ec15b"
server_key_version: "encryptionkey@0"
I20260808 17:52:40.244750 17716 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:52:40.245388 17736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:40.245524 17716 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:40.245606 17716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-2/wal
uuid: "4382469f94c745a6ac6c3b6aebfe9278"
format_stamp: "Formatted at 2026-08-08 17:52:40 on dist-test-slave-bndk"
server_key: "90b712d0d6eb9b1b4da3820b915a9f20"
server_key_iv: "aeab1d6e92646839177eaae1551ec15b"
server_key_version: "encryptionkey@0"
I20260808 17:52:40.245666 17716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:40.258599 17704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } attempt: 2
I20260808 17:52:40.258937 17707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.258823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:46131 (local address 127.0.0.1:35822)
0808 17:52:40.258875 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.258908 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:46131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 17:52:40.259218 17707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.259141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:46131 (local address 127.0.0.1:35826)
0808 17:52:40.259177 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.259199 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:46131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 17:52:40.259292 17704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.188:46131: Network error: Client connection negotiation failed: client connection to 127.28.213.188:46131: connect: Connection refused (error 111)
I20260808 17:52:40.262269 17716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:40.263806 17716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:40.263907 17716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:40.267433 17716 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.188:46131
I20260808 17:52:40.267464 17817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.188:46131 every 8 connection(s)
I20260808 17:52:40.267752 17716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-2/data/info.pb
I20260808 17:52:40.268530 17818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:52:40.269960 17818 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:52:40.273849 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 17716
I20260808 17:52:40.273967 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786211411189989-29526-0/minicluster-data/master-2/wal/instance
I20260808 17:52:40.274168 29526 external_mini_cluster.cc:1428] Setting key ba9d38fafcc1b1316789a821bb70b50a
Aug 08 17:52:40 dist-test-slave-bndk krb5kdc[17437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211560, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.188@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:52:40.278855 17581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.270556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55102 (local address 127.28.213.190:41169)
0808 17:52:40.270608 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:40.270610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:40.270793 (+ 183us) server_negotiation.cc:407] Connection header received
0808 17:52:40.271240 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:40.271242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:40.271255 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:40.271314 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:40.271887 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.272356 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.273295 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.273491 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.273548 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.275791 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:40.275792 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:40.275793 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:40.275799 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:40.277618 (+ 1819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.277992 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.277994 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.277994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.278052 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.278264 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.278266 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.278266 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.278377 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:40.278434 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:40.278682 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 17:52:40.278767 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 17:52:40.278978 17822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.270534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:41169 (local address 127.0.0.1:55102)
0808 17:52:40.270678 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.270711 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:40.271149 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:40.271396 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:40.271400 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:40.271624 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:40.271800 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:40.271804 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.272443 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.272444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:40.273195 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:40.273198 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.273559 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.273560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:40.273676 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.274176 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:40.274186 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:40.275714 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:40.277687 (+ 1973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:40.277693 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:40.277695 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:40.277924 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:40.278106 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:40.278107 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:40.278107 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:40.278208 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:40.278433 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:40.278440 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:40.278566 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 17:52:40.278651 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 17:52:40.278785 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":64,"threads_started":1}
Aug 08 17:52:40 dist-test-slave-bndk krb5kdc[17437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.188@KRBTEST.COM
I20260808 17:52:40.279477 17818 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:52:40.282377 17826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.274543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35842 (local address 127.28.213.188:46131)
0808 17:52:40.274679 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:40.274683 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:40.274718 (+ 35us) server_negotiation.cc:407] Connection header received
0808 17:52:40.274791 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:40.274794 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:40.274813 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:40.274895 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:40.275431 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.276338 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.277358 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.277639 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.277708 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.279833 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:40.279841 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:40.279841 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:40.279848 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:40.281348 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.281647 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.281650 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.281651 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.281705 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.281869 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.281870 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.281871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.282012 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:40.282131 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:40.282213 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 17:52:40.282283 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":72,"threads_started":1}
Aug 08 17:52:40 dist-test-slave-bndk krb5kdc[17437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211560, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.188@KRBTEST.COM for kudu/127.28.213.189@KRBTEST.COM
I20260808 17:52:40.285637 17822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.279682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:44423 (local address 127.0.0.1:47134)
0808 17:52:40.279720 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.279729 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:40.279763 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:40.279912 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:40.279913 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:40.280055 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:40.280108 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:40.280110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.280928 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.280929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:40.281430 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:40.281433 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.281763 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.281764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:40.281827 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.282136 (+ 309us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:40.282141 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:40.283298 (+ 1157us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:40.284725 (+ 1427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:40.284726 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:40.284726 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:40.284874 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:40.285047 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:40.285047 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:40.285048 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:40.285092 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:40.285353 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:40.285354 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:40.285393 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 17:52:40.285474 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 17:52:40.285556 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 17:52:40.285647 17709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.279753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47134 (local address 127.28.213.189:44423)
0808 17:52:40.279817 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:40.279819 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:40.279826 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:52:40.279849 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:40.279850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:40.279859 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:40.279903 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:40.280171 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.280851 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.281504 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.281705 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.281761 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.283357 (+ 1596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:40.283359 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:40.283359 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:40.283367 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:40.284655 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.284942 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.284943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.284943 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.284999 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.285143 (+ 144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.285144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.285144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.285294 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:40.285346 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:40.285493 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 17:52:40.285566 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 17:52:40.285954 17818 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:52:40 dist-test-slave-bndk krb5kdc[17437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
Aug 08 17:52:40 dist-test-slave-bndk krb5kdc[17437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211560, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.188@KRBTEST.COM for kudu/127.28.213.188@KRBTEST.COM
I20260808 17:52:40.290112 17581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.283064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55114 (local address 127.28.213.190:41169)
0808 17:52:40.283096 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:40.283098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:40.283183 (+ 85us) server_negotiation.cc:407] Connection header received
0808 17:52:40.283222 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:40.283222 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:40.283232 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:40.283271 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:40.283817 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.284359 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.285191 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.285480 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.285537 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.287732 (+ 2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:40.287733 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:40.287734 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:40.287740 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:40.289119 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.289433 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.289434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.289435 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.289488 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.289644 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.289644 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.289645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.289747 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:40.289919 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:40.289957 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 17:52:40.290028 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:52:40.292369 17822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.286172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:46131 (local address 127.0.0.1:35850)
0808 17:52:40.286214 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.286223 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:40.286257 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:40.286384 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:40.286385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:40.286488 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:40.286513 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:40.286514 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.287668 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.287669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:40.288270 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:40.288273 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.288664 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.288665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:40.288704 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.288999 (+ 295us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:40.289004 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:40.290039 (+ 1035us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:40.291551 (+ 1512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:40.291552 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:40.291552 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:40.291697 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:40.291853 (+ 156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:40.291853 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:40.291854 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:40.291903 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:40.292096 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:40.292096 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:40.292132 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 17:52:40.292191 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:52:40.292279 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 17:52:40.292426 17826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.286199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35850 (local address 127.28.213.188:46131)
0808 17:52:40.286233 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:40.286235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:40.286246 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:52:40.286315 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:40.286316 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:40.286326 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:40.286382 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:40.286567 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.287550 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.288350 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.288594 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.288662 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.290112 (+ 1450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:40.290113 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:40.290113 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:40.290119 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:40.291490 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.291754 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.291755 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.291755 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.291802 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.291952 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.291953 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.291953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.292045 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:40.292096 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:40.292215 (+ 119us) server_negotiation.cc:299] Negotiation successful
0808 17:52:40.292327 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":16}
I20260808 17:52:40.293771 17818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278: Bootstrap starting.
Aug 08 17:52:40 dist-test-slave-bndk krb5kdc[17437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.189@KRBTEST.COM
I20260808 17:52:40.294756 17818 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278: Neither blocks nor log segments found. Creating new log.
I20260808 17:52:40.295071 17818 log.cc:824] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278: Log is configured to *not* fsync() on all Append() calls
I20260808 17:52:40.295640 17577 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } attempt: 2
I20260808 17:52:40.295981 17818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278: No bootstrap required, opened a new log
I20260808 17:52:40.296981 17709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.290632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47136 (local address 127.28.213.189:44423)
0808 17:52:40.290665 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:40.290666 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:40.290674 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:52:40.290734 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:40.290734 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:40.290741 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:40.290779 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:40.291282 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.291692 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.292283 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.292501 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.292560 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.294634 (+ 2074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:40.294636 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:40.294636 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:40.294642 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:40.295976 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.296332 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.296334 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.296334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.296390 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.296560 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.296561 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.296561 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.296662 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:40.296799 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:40.296835 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 17:52:40.296898 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 17:52:40.297896 17818 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } } peers { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } } peers { permanent_uuid: "4382469f94c745a6ac6c3b6aebfe9278" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } }
I20260808 17:52:40.298038 17818 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:52:40.298075 17818 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4382469f94c745a6ac6c3b6aebfe9278, State: Initialized, Role: FOLLOWER
I20260808 17:52:40.298188 17818 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } } peers { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } } peers { permanent_uuid: "4382469f94c745a6ac6c3b6aebfe9278" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } }
I20260808 17:52:40.298472 17828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } } peers { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } } peers { permanent_uuid: "4382469f94c745a6ac6c3b6aebfe9278" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } } }
I20260808 17:52:40.298511 17818 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:52:40.298564 17828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [sys.catalog]: This master's current role is: FOLLOWER
Aug 08 17:52:40 dist-test-slave-bndk krb5kdc[17437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211559, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for kudu/127.28.213.188@KRBTEST.COM
I20260808 17:52:40.299499 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260808 17:52:40.301180 17845 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:52:40.301311 17845 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:52:40.302523 17580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.295880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:46131 (local address 127.0.0.1:35862)
0808 17:52:40.295941 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.295950 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:40.295986 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:40.296155 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:40.296156 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:40.296292 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:40.296330 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:40.296331 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.297102 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.297104 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:40.297793 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:40.297796 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.298239 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.298240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:40.298284 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.298628 (+ 344us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:40.298632 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:40.299700 (+ 1068us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:40.301436 (+ 1736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:40.301437 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:40.301437 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:40.301642 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:40.301851 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:40.301852 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:40.301852 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:40.301927 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:40.302237 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:40.302237 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:40.302281 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 17:52:40.302344 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 17:52:40.302435 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 17:52:40.302791 17826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.295923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35862 (local address 127.28.213.188:46131)
0808 17:52:40.296048 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:40.296050 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:40.296057 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:52:40.296074 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:40.296075 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:40.296083 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:40.296135 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:40.296399 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.297030 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.297880 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.298138 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.298194 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.299776 (+ 1582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:40.299777 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:40.299777 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:40.299784 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:40.301347 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.301722 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.301723 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.301724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.301781 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.301989 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.301990 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.301990 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.302149 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:40.302209 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:40.302643 (+ 434us) server_negotiation.cc:299] Negotiation successful
0808 17:52:40.302715 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260808 17:52:40.301208 17716 master_runner.cc:186] Error getting master registration for 127.28.213.190:41169: OK, instance_id { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" instance_seqno: 1786211559956075 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 17:52:40.303992 17716 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 17:52:40.304260 17577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44: Bootstrap starting.
I20260808 17:52:40.304982 17577 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44: Neither blocks nor log segments found. Creating new log.
I20260808 17:52:40.305330 17577 log.cc:824] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44: Log is configured to *not* fsync() on all Append() calls
I20260808 17:52:40.306254 17577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44: No bootstrap required, opened a new log
I20260808 17:52:40.308210 17577 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } } peers { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } } peers { permanent_uuid: "4382469f94c745a6ac6c3b6aebfe9278" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } }
I20260808 17:52:40.308339 17577 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:52:40.308368 17577 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ac3b58a654d4f558400170f7ffbeb44, State: Initialized, Role: FOLLOWER
I20260808 17:52:40.308887 17577 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } } peers { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } } peers { permanent_uuid: "4382469f94c745a6ac6c3b6aebfe9278" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } }
I20260808 17:52:40.309259 17577 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:52:40.311021 17581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.300859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55126 (local address 127.28.213.190:41169)
0808 17:52:40.300892 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:40.300893 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:40.301849 (+ 956us) server_negotiation.cc:407] Connection header received
0808 17:52:40.301933 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:40.301934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:40.301943 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:40.301971 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:40.302714 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.303305 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.303939 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.304196 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.304255 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.305696 (+ 1441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:40.305697 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:40.305697 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:40.305704 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:40.309686 (+ 3982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.310083 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.310085 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.310085 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.310140 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.310326 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.310327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.310328 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.310463 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:40.310561 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:40.310870 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 17:52:40.310943 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 17:52:40.311517 17875 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:52:40.311568 17875 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:52:40.311892 17709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.301537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47144 (local address 127.28.213.189:44423)
0808 17:52:40.301570 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:40.301572 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:40.304165 (+ 2593us) server_negotiation.cc:407] Connection header received
0808 17:52:40.304210 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:40.304211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:40.304221 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:40.304266 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:40.304919 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.305447 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.306592 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.306864 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.306900 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.308529 (+ 1629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:40.308530 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:40.308531 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:40.308538 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:40.310441 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.310822 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.310823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.310823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.310881 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.311101 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.311102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.311103 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.311222 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:40.311304 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:40.311505 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 17:52:40.311807 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 17:52:40.311951 17459 master_runner.cc:186] Error getting master registration for 127.28.213.189:44423: OK, instance_id { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" instance_seqno: 1786211560119139 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 17:52:40.313689 17459 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 17:52:40.314100 17854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.301029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35874 (local address 127.28.213.188:46131)
0808 17:52:40.301466 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:40.301467 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:40.301629 (+ 162us) server_negotiation.cc:407] Connection header received
0808 17:52:40.301646 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:40.301647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:40.301655 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:40.301706 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:40.302453 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.305974 (+ 3521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.306884 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.307192 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.307251 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.308632 (+ 1381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:40.308633 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:40.308633 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:40.308640 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:40.312649 (+ 4009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.313033 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.313034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.313034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.313090 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.313319 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.313320 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.313320 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.313461 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:40.313542 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:40.313914 (+ 372us) server_negotiation.cc:299] Negotiation successful
0808 17:52:40.313990 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":75,"threads_started":1}
I20260808 17:52:40.317344 17861 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } } peers { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } } peers { permanent_uuid: "4382469f94c745a6ac6c3b6aebfe9278" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } } }
I20260808 17:52:40.317454 17861 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:52:40.350433 17704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } attempt: 3
Aug 08 17:52:40 dist-test-slave-bndk krb5kdc[17437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211560, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.189@KRBTEST.COM for kudu/127.28.213.188@KRBTEST.COM
I20260808 17:52:40.358450 17707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.350697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:46131 (local address 127.0.0.1:35880)
0808 17:52:40.350750 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:40.350763 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:40.350806 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:40.350938 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:40.350940 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:40.351131 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:40.351182 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:40.351184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.352112 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.352113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:40.352924 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:40.352928 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.353438 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.353439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:40.353502 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.354003 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:40.354009 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:40.355533 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:40.357371 (+ 1838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:40.357372 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:40.357373 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:40.357599 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:40.357803 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:40.357804 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:40.357804 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:40.357870 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:40.358135 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:40.358136 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:40.358181 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 17:52:40.358249 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 17:52:40.358341 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 17:52:40.358482 17854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:40.350750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35880 (local address 127.28.213.188:46131)
0808 17:52:40.350790 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:40.350792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:40.350800 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:52:40.350856 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:40.350857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:40.350867 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:40.350927 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:40.351258 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.352031 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.353008 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:40.353364 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:40.353728 (+ 364us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:40.355633 (+ 1905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:40.355635 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:40.355635 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:40.355643 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:40.357296 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.357671 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.357672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.357673 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.357743 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:40.357927 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:40.357928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:40.357928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:40.358071 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:40.358139 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:40.358278 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 17:52:40.358363 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:52:40.360402 17704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3: Bootstrap starting.
I20260808 17:52:40.361145 17704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3: Neither blocks nor log segments found. Creating new log.
I20260808 17:52:40.361477 17704 log.cc:824] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3: Log is configured to *not* fsync() on all Append() calls
I20260808 17:52:40.362342 17704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3: No bootstrap required, opened a new log
I20260808 17:52:40.364269 17704 raft_consensus.cc:348] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } } peers { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } } peers { permanent_uuid: "4382469f94c745a6ac6c3b6aebfe9278" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } }
I20260808 17:52:40.364392 17704 raft_consensus.cc:374] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:52:40.364437 17704 raft_consensus.cc:729] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17db9cb7c1ce4129b084a112875c30f3, State: Initialized, Role: FOLLOWER
I20260808 17:52:40.364552 17704 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } } peers { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } } peers { permanent_uuid: "4382469f94c745a6ac6c3b6aebfe9278" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } }
I20260808 17:52:40.365291 17881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } } peers { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } } peers { permanent_uuid: "4382469f94c745a6ac6c3b6aebfe9278" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } } }
I20260808 17:52:40.365347 17704 sys_catalog.cc:564] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:52:40.365427 17881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 17:52:40.366971 17622 tablet.cc:2369] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:52:40.367539 17899 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:52:40.367617 17899 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:52:40.369376 17585 master_runner.cc:263] No leader master found from master 17db9cb7c1ce4129b084a112875c30f3
I20260808 17:52:40.369439 17585 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 17:52:40.454111 17497 tablet.cc:2369] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:52:40.492712 17828 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:52:40.492858 17828 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } } peers { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } } peers { permanent_uuid: "4382469f94c745a6ac6c3b6aebfe9278" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } }
I20260808 17:52:40.493110 17828 leader_election.cc:288] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ac3b58a654d4f558400170f7ffbeb44 (127.28.213.190:41169), 17db9cb7c1ce4129b084a112875c30f3 (127.28.213.189:44423)
I20260808 17:52:40.493388 17661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4382469f94c745a6ac6c3b6aebfe9278" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17db9cb7c1ce4129b084a112875c30f3" is_pre_election: true
I20260808 17:52:40.493369 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4382469f94c745a6ac6c3b6aebfe9278" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ac3b58a654d4f558400170f7ffbeb44" is_pre_election: true
I20260808 17:52:40.493538 17661 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4382469f94c745a6ac6c3b6aebfe9278 in term 0.
I20260808 17:52:40.493538 17528 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4382469f94c745a6ac6c3b6aebfe9278 in term 0.
I20260808 17:52:40.493711 17740 leader_election.cc:302] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17db9cb7c1ce4129b084a112875c30f3, 4382469f94c745a6ac6c3b6aebfe9278; no voters:
I20260808 17:52:40.493858 17828 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:52:40.493927 17828 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:52:40.493944 17828 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:52:40.494608 17828 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } } peers { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } } peers { permanent_uuid: "4382469f94c745a6ac6c3b6aebfe9278" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } }
I20260808 17:52:40.494716 17828 leader_election.cc:288] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [CANDIDATE]: Term 1 election: Requested vote from peers 6ac3b58a654d4f558400170f7ffbeb44 (127.28.213.190:41169), 17db9cb7c1ce4129b084a112875c30f3 (127.28.213.189:44423)
I20260808 17:52:40.494861 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4382469f94c745a6ac6c3b6aebfe9278" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ac3b58a654d4f558400170f7ffbeb44"
I20260808 17:52:40.494930 17661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4382469f94c745a6ac6c3b6aebfe9278" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17db9cb7c1ce4129b084a112875c30f3"
I20260808 17:52:40.494954 17528 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:52:40.494999 17661 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:52:40.495760 17661 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4382469f94c745a6ac6c3b6aebfe9278 in term 1.
I20260808 17:52:40.495760 17528 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4382469f94c745a6ac6c3b6aebfe9278 in term 1.
I20260808 17:52:40.495939 17740 leader_election.cc:302] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17db9cb7c1ce4129b084a112875c30f3, 4382469f94c745a6ac6c3b6aebfe9278; no voters:
I20260808 17:52:40.496026 17828 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:52:40.496169 17828 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [term 1 LEADER]: Becoming Leader. State: Replica: 4382469f94c745a6ac6c3b6aebfe9278, State: Running, Role: LEADER
I20260808 17:52:40.496259 17828 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } } peers { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } } peers { permanent_uuid: "4382469f94c745a6ac6c3b6aebfe9278" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } }
I20260808 17:52:40.496649 17902 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4382469f94c745a6ac6c3b6aebfe9278. Latest consensus state: current_term: 1 leader_uuid: "4382469f94c745a6ac6c3b6aebfe9278" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } } peers { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } } peers { permanent_uuid: "4382469f94c745a6ac6c3b6aebfe9278" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } } }
I20260808 17:52:40.496745 17902 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [sys.catalog]: This master's current role is: LEADER
I20260808 17:52:40.496954 17904 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:52:40.497134 17904 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:52:40.498315 17528 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44 [term 1 FOLLOWER]: Refusing update from remote peer 4382469f94c745a6ac6c3b6aebfe9278: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:52:40.498335 17661 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3 [term 1 FOLLOWER]: Refusing update from remote peer 4382469f94c745a6ac6c3b6aebfe9278: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:52:40.498623 17902 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:52:40.498797 17828 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:52:40.499859 17881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4382469f94c745a6ac6c3b6aebfe9278. Latest consensus state: current_term: 1 leader_uuid: "4382469f94c745a6ac6c3b6aebfe9278" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } } peers { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } } peers { permanent_uuid: "4382469f94c745a6ac6c3b6aebfe9278" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } } }
I20260808 17:52:40.499962 17881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:52:40.500048 17861 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4382469f94c745a6ac6c3b6aebfe9278. Latest consensus state: current_term: 1 leader_uuid: "4382469f94c745a6ac6c3b6aebfe9278" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } } peers { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } } peers { permanent_uuid: "4382469f94c745a6ac6c3b6aebfe9278" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } } }
I20260808 17:52:40.500120 17861 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:52:40.500756 17828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4382469f94c745a6ac6c3b6aebfe9278" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } } peers { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } } peers { permanent_uuid: "4382469f94c745a6ac6c3b6aebfe9278" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } } }
I20260808 17:52:40.500836 17828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [sys.catalog]: This master's current role is: LEADER
I20260808 17:52:40.501206 17881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4382469f94c745a6ac6c3b6aebfe9278" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } } peers { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } } peers { permanent_uuid: "4382469f94c745a6ac6c3b6aebfe9278" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } } }
I20260808 17:52:40.501302 17881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:52:40.501379 17902 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4382469f94c745a6ac6c3b6aebfe9278" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } } peers { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } } peers { permanent_uuid: "4382469f94c745a6ac6c3b6aebfe9278" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } } }
I20260808 17:52:40.501457 17902 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278 [sys.catalog]: This master's current role is: LEADER
I20260808 17:52:40.501574 17904 catalog_manager.cc:1347] Generated new cluster ID: 4b46820c9ec64d428e7516958cb21cd1
I20260808 17:52:40.501562 17907 mvcc.cc:205] Tried to move back new op lower bound from 7316322551799296000 to 7316322551793180672. Current Snapshot: MvccSnapshot[applied={T|T < 7316322551799296000}]
I20260808 17:52:40.501653 17904 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:52:40.501935 17861 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4382469f94c745a6ac6c3b6aebfe9278" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ac3b58a654d4f558400170f7ffbeb44" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 41169 } } peers { permanent_uuid: "17db9cb7c1ce4129b084a112875c30f3" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 44423 } } peers { permanent_uuid: "4382469f94c745a6ac6c3b6aebfe9278" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 46131 } } }
I20260808 17:52:40.502010 17861 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:52:40.505378 17904 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:52:40.505898 17904 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:52:40.522812 17904 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4382469f94c745a6ac6c3b6aebfe9278: Generated new TSK 0
I20260808 17:52:40.523036 17904 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:52:41.311997 17875 catalog_manager.cc:1259] Loaded cluster ID: 4b46820c9ec64d428e7516958cb21cd1
I20260808 17:52:41.312090 17875 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44: loading cluster ID for follower catalog manager: success
I20260808 17:52:41.312923 17875 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44: acquiring CA information for follower catalog manager: success
I20260808 17:52:41.313256 17875 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6ac3b58a654d4f558400170f7ffbeb44: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 17:52:41.368058 17899 catalog_manager.cc:1259] Loaded cluster ID: 4b46820c9ec64d428e7516958cb21cd1
I20260808 17:52:41.368134 17899 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3: loading cluster ID for follower catalog manager: success
I20260808 17:52:41.368978 17899 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3: acquiring CA information for follower catalog manager: success
I20260808 17:52:41.369307 17899 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 17db9cb7c1ce4129b084a112875c30f3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 17:52:41.585336 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 17459
I20260808 17:52:41.594712 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 17585
I20260808 17:52:41.603487 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 17716
2026-08-08T17:52:41Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2989 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:52:41 dist-test-slave-bndk krb5kdc[17925](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:52:41 dist-test-slave-bndk krb5kdc[17925](info): set up 2 sockets
Aug 08 17:52:41 dist-test-slave-bndk krb5kdc[17925](info): commencing operation
krb5kdc: starting...
W20260808 17:52:42.717550 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:52:42 dist-test-slave-bndk krb5kdc[17925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:52:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:52:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:52:42.828998 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:39891
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:45841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:39891
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:52:42.907894 17948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:42.908092 17948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:42.908121 17948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:42.909243 17948 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:52:42.909288 17948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:42.909305 17948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:42.909322 17948 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:52:42.909340 17948 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:52:42.910789 17948 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:45841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:39891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:39891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:42.911029 17948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:42.911230 17948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:42.915701 17961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:42.915727 17958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:42.915771 17948 server_base.cc:1034] running on GCE node
W20260808 17:52:42.915735 17957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:42.916155 17948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:42.916388 17948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:42.917527 17948 hybrid_clock.cc:648] HybridClock initialized: now 1786211562917517 us; error 28 us; skew 500 ppm
Aug 08 17:52:42 dist-test-slave-bndk krb5kdc[17925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211562, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:42.919849 17948 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:52:42.920233 17948 webserver.cc:460] Webserver started at http://127.28.213.190:33431/ using document root <none> and password file <none>
I20260808 17:52:42.920429 17948 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:42.920471 17948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:42.920589 17948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:52:42.921614 17948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "2f49589e212842c892ff88412f9be926"
format_stamp: "Formatted at 2026-08-08 17:52:42 on dist-test-slave-bndk"
server_key: "1c1e74a6710831f97676859d3500c7e3"
server_key_iv: "722d4718270d6c6949cb4186acebc79d"
server_key_version: "encryptionkey@0"
I20260808 17:52:42.921936 17948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "2f49589e212842c892ff88412f9be926"
format_stamp: "Formatted at 2026-08-08 17:52:42 on dist-test-slave-bndk"
server_key: "1c1e74a6710831f97676859d3500c7e3"
server_key_iv: "722d4718270d6c6949cb4186acebc79d"
server_key_version: "encryptionkey@0"
I20260808 17:52:42.923219 17948 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:52:42.923885 17971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:42.924059 17948 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:52:42.924140 17948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "2f49589e212842c892ff88412f9be926"
format_stamp: "Formatted at 2026-08-08 17:52:42 on dist-test-slave-bndk"
server_key: "1c1e74a6710831f97676859d3500c7e3"
server_key_iv: "722d4718270d6c6949cb4186acebc79d"
server_key_version: "encryptionkey@0"
I20260808 17:52:42.924192 17948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:42.959625 17948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:42.961403 17948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:42.961513 17948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:42.965240 17948 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:39891
I20260808 17:52:42.965291 18053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:39891 every 8 connection(s)
I20260808 17:52:42.965617 17948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:52:42.966431 18054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:52:42.968667 18054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926: Bootstrap starting.
I20260808 17:52:42.969272 18054 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926: Neither blocks nor log segments found. Creating new log.
I20260808 17:52:42.969539 18054 log.cc:824] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926: Log is configured to *not* fsync() on all Append() calls
I20260808 17:52:42.970184 18054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926: No bootstrap required, opened a new log
I20260808 17:52:42.971750 18054 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f49589e212842c892ff88412f9be926" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39891 } }
I20260808 17:52:42.971884 18054 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:52:42.971927 18054 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f49589e212842c892ff88412f9be926, State: Initialized, Role: FOLLOWER
I20260808 17:52:42.972069 18054 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f49589e212842c892ff88412f9be926" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39891 } }
I20260808 17:52:42.972146 18054 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:52:42.972182 18054 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:52:42.972227 18054 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:52:42.972733 18054 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f49589e212842c892ff88412f9be926" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39891 } }
I20260808 17:52:42.972826 18054 leader_election.cc:302] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f49589e212842c892ff88412f9be926; no voters:
I20260808 17:52:42.973006 18054 leader_election.cc:288] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:52:42.973042 18059 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:52:42.973052 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 17948
I20260808 17:52:42.973145 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:52:42.973208 18059 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926 [term 1 LEADER]: Becoming Leader. State: Replica: 2f49589e212842c892ff88412f9be926, State: Running, Role: LEADER
I20260808 17:52:42.973285 18054 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:52:42.973320 18059 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f49589e212842c892ff88412f9be926" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39891 } }
I20260808 17:52:42.973371 29526 external_mini_cluster.cc:1428] Setting key 36345e8c5b221bd35c5cafb71f2aedc9
I20260808 17:52:42.974201 18062 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f49589e212842c892ff88412f9be926. Latest consensus state: current_term: 1 leader_uuid: "2f49589e212842c892ff88412f9be926" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f49589e212842c892ff88412f9be926" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39891 } } }
I20260808 17:52:42.974597 18062 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926 [sys.catalog]: This master's current role is: LEADER
I20260808 17:52:42.974512 18061 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f49589e212842c892ff88412f9be926" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f49589e212842c892ff88412f9be926" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39891 } } }
I20260808 17:52:42.974800 18061 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926 [sys.catalog]: This master's current role is: LEADER
W20260808 17:52:42.975122 18085 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:52:42.975451 18085 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:52:42.976905 18086 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:52:42.977095 18086 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:52:42.978899 18086 catalog_manager.cc:1347] Generated new cluster ID: ad5625d15f304b3f99d7388e4eefc0d1
I20260808 17:52:42.978953 18086 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:52:42 dist-test-slave-bndk krb5kdc[17925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:52:42.983805 18067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:42.973782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35140 (local address 127.28.213.190:39891)
0808 17:52:42.974187 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:42.974197 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:42.974231 (+ 34us) server_negotiation.cc:407] Connection header received
0808 17:52:42.974356 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:42.974364 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:42.974446 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:42.975372 (+ 926us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:42.975472 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:42.976782 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:42.977624 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:42.978170 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:42.978277 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:42.980453 (+ 2176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:42.980457 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:42.980457 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:42.980468 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:42.982456 (+ 1988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:42.982762 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:42.982765 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:42.982765 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:42.982854 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:42.983035 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:42.983036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:42.983036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:42.983248 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:42.983388 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:42.983495 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 17:52:42.983624 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":74,"threads_started":1}
I20260808 17:52:42.984669 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:52:42.987106 18086 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:52:42.987605 18086 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:52:42.992168 18086 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f49589e212842c892ff88412f9be926: Generated new TSK 0
I20260808 17:52:42.992332 18086 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:52:43.038079 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 17948
2026-08-08T17:52:43Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1444 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:52:43 dist-test-slave-bndk krb5kdc[18101](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:52:43 dist-test-slave-bndk krb5kdc[18101](info): set up 2 sockets
Aug 08 17:52:43 dist-test-slave-bndk krb5kdc[18101](info): commencing operation
krb5kdc: starting...
W20260808 17:52:44.168016 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:52:44 dist-test-slave-bndk krb5kdc[18101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:52:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:52:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:52:44.280129 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:44721
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:44721
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:52:44.359959 18123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:44.360155 18123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:44.360188 18123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:44.361304 18123 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:52:44.361351 18123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:44.361371 18123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:44.361387 18123 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:52:44.361403 18123 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:52:44.362850 18123 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:44721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:44721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18123
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:44.363078 18123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:44.363286 18123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:44.367645 18132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:44.367658 18136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:44.367659 18134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:44.367935 18123 server_base.cc:1034] running on GCE node
I20260808 17:52:44.368139 18123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:44.368423 18123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:44.369558 18123 hybrid_clock.cc:648] HybridClock initialized: now 1786211564369537 us; error 36 us; skew 500 ppm
Aug 08 17:52:44 dist-test-slave-bndk krb5kdc[18101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211564, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:44.371867 18123 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:52:44.372277 18123 webserver.cc:460] Webserver started at http://127.28.213.190:37621/ using document root <none> and password file <none>
I20260808 17:52:44.372488 18123 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:44.372534 18123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:44.372661 18123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:52:44.373705 18123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "59ebcde977bb4cc0bb44103201cdac92"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "937ff6a04f7377ce69b7ac51b9a30658"
server_key_iv: "e4cd0a5505afd89e0a984391df89dc0a"
server_key_version: "encryptionkey@0"
I20260808 17:52:44.374032 18123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "59ebcde977bb4cc0bb44103201cdac92"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "937ff6a04f7377ce69b7ac51b9a30658"
server_key_iv: "e4cd0a5505afd89e0a984391df89dc0a"
server_key_version: "encryptionkey@0"
I20260808 17:52:44.375233 18123 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:52:44.375882 18143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:44.376034 18123 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:52:44.376112 18123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "59ebcde977bb4cc0bb44103201cdac92"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "937ff6a04f7377ce69b7ac51b9a30658"
server_key_iv: "e4cd0a5505afd89e0a984391df89dc0a"
server_key_version: "encryptionkey@0"
I20260808 17:52:44.376174 18123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:44.393378 18123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:44.395083 18123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:44.395206 18123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:44.398952 18123 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:44721
I20260808 17:52:44.398995 18224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:44721 every 8 connection(s)
I20260808 17:52:44.399283 18123 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:52:44.400192 18226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:52:44.402309 18226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92: Bootstrap starting.
I20260808 17:52:44.402810 18226 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92: Neither blocks nor log segments found. Creating new log.
I20260808 17:52:44.403046 18226 log.cc:824] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92: Log is configured to *not* fsync() on all Append() calls
I20260808 17:52:44.403645 18226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92: No bootstrap required, opened a new log
I20260808 17:52:44.404439 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 18123
I20260808 17:52:44.404542 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:52:44.404721 29526 external_mini_cluster.cc:1428] Setting key b955dc8a65595de4439d867b93892c72
I20260808 17:52:44.405539 18226 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ebcde977bb4cc0bb44103201cdac92" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44721 } }
I20260808 17:52:44.405697 18226 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:52:44.405772 18226 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59ebcde977bb4cc0bb44103201cdac92, State: Initialized, Role: FOLLOWER
I20260808 17:52:44.405901 18226 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ebcde977bb4cc0bb44103201cdac92" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44721 } }
I20260808 17:52:44.405979 18226 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:52:44.406001 18226 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:52:44.406045 18226 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:52:44.407002 18226 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ebcde977bb4cc0bb44103201cdac92" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44721 } }
I20260808 17:52:44.407109 18226 leader_election.cc:302] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59ebcde977bb4cc0bb44103201cdac92; no voters:
I20260808 17:52:44.407253 18226 leader_election.cc:288] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:52:44.407289 18235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:52:44.407449 18235 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 1 LEADER]: Becoming Leader. State: Replica: 59ebcde977bb4cc0bb44103201cdac92, State: Running, Role: LEADER
I20260808 17:52:44.407485 18226 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:52:44.407594 18235 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ebcde977bb4cc0bb44103201cdac92" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44721 } }
I20260808 17:52:44.408008 18237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59ebcde977bb4cc0bb44103201cdac92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ebcde977bb4cc0bb44103201cdac92" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44721 } } }
I20260808 17:52:44.408142 18237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [sys.catalog]: This master's current role is: LEADER
I20260808 17:52:44.408392 18245 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:52:44.408908 18245 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:52:44.409008 18236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59ebcde977bb4cc0bb44103201cdac92. Latest consensus state: current_term: 1 leader_uuid: "59ebcde977bb4cc0bb44103201cdac92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ebcde977bb4cc0bb44103201cdac92" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44721 } } }
I20260808 17:52:44.409106 18236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [sys.catalog]: This master's current role is: LEADER
I20260808 17:52:44.410372 18245 catalog_manager.cc:1347] Generated new cluster ID: 0e01015f3f624576bd8757806ba99fff
I20260808 17:52:44.410425 18245 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:52:44 dist-test-slave-bndk krb5kdc[18101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:52:44.414690 18232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:44.405190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47292 (local address 127.28.213.190:44721)
0808 17:52:44.405385 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:44.405394 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:44.405427 (+ 33us) server_negotiation.cc:407] Connection header received
0808 17:52:44.405540 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:44.405546 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:44.405600 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:44.405740 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:44.406386 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.407759 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.408775 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.409402 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.409506 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:44.411785 (+ 2279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:44.411789 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:44.411790 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:44.411801 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:44.413279 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:44.413573 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:44.413576 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:44.413577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:44.413678 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:44.413848 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:44.413849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:44.413849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:44.414066 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:44.414208 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:44.414403 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 17:52:44.414532 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":97,"threads_started":1}
I20260808 17:52:44.427158 18245 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:52:44.427623 18245 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:52:44.436606 18245 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92: Generated new TSK 0
I20260808 17:52:44.436748 18245 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
I20260808 17:52:44.467628 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:44721
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:52:44.552805 18263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:44.553000 18263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:44.553035 18263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:44.554194 18263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:44.554239 18263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:44.554272 18263 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:52:44.555658 18263 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:44721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18263
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:44.555878 18263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:44.556082 18263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:44.560783 18277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:44.560848 18274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:44.560788 18271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:44.560858 18263 server_base.cc:1034] running on GCE node
I20260808 17:52:44.561148 18263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:44.561389 18263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:44.562559 18263 hybrid_clock.cc:648] HybridClock initialized: now 1786211564562544 us; error 31 us; skew 500 ppm
Aug 08 17:52:44 dist-test-slave-bndk krb5kdc[18101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211564, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:44.564939 18263 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:52:44.565371 18263 webserver.cc:460] Webserver started at http://127.28.213.129:33449/ using document root <none> and password file <none>
I20260808 17:52:44.565598 18263 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:44.565646 18263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:44.565769 18263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:52:44.566744 18263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "635c62adb2ed40d0b9817fbb589789f1"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "50283a05bb06f91accf7ce1c2b5f12cf"
server_key_iv: "397143afbcb581ff8f6e203b83f86e46"
server_key_version: "encryptionkey@0"
I20260808 17:52:44.567070 18263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "635c62adb2ed40d0b9817fbb589789f1"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "50283a05bb06f91accf7ce1c2b5f12cf"
server_key_iv: "397143afbcb581ff8f6e203b83f86e46"
server_key_version: "encryptionkey@0"
I20260808 17:52:44.568310 18263 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:52:44.568996 18284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:44.569152 18263 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:52:44.569252 18263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "635c62adb2ed40d0b9817fbb589789f1"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "50283a05bb06f91accf7ce1c2b5f12cf"
server_key_iv: "397143afbcb581ff8f6e203b83f86e46"
server_key_version: "encryptionkey@0"
I20260808 17:52:44.569319 18263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:44.581679 18263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:44.583251 18263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:44.583374 18263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:44.583567 18263 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:52:44.583838 18263 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:52:44.583871 18263 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:44.583897 18263 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:52:44.583915 18263 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:44.589180 18263 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:40761
I20260808 17:52:44.589262 18480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:40761 every 8 connection(s)
I20260808 17:52:44.589535 18263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:52:44.592433 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 18263
I20260808 17:52:44.592527 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:52:44.592697 29526 external_mini_cluster.cc:1428] Setting key 7a02102f912cd330e6dde436017538e5
Aug 08 17:52:44 dist-test-slave-bndk krb5kdc[18101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211564, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:52:44.598446 18232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:44.590161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:55905 (local address 127.28.213.190:44721)
0808 17:52:44.590220 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:44.590222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:44.590396 (+ 174us) server_negotiation.cc:407] Connection header received
0808 17:52:44.590817 (+ 421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:44.590819 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:44.590831 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:44.590879 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:44.591735 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.592219 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.593277 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.593535 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.593593 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:44.595776 (+ 2183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:44.595778 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:44.595778 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:44.595787 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:44.597052 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:44.597571 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:44.597571 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:44.597572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:44.597632 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:44.597881 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:44.597882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:44.597882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:44.597987 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:44.598033 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:44.598318 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 17:52:44.598383 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 17:52:44.598696 18484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:44.590146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:55905)
0808 17:52:44.590285 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:44.590316 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:44.590745 (+ 429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:44.590952 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:44.590955 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:44.591491 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:44.591668 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:44.591673 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.592275 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.592276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:44.593181 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:44.593184 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.593620 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.593621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:44.593747 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:44.594175 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:44.594185 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:44.595678 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:44.597128 (+ 1450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:44.597136 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:44.597138 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:44.597499 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:44.597693 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:44.597694 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:44.597694 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:44.597826 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:44.598039 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:44.598044 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:44.598196 (+ 152us) client_negotiation.cc:769] Sending connection context
0808 17:52:44.598305 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 17:52:44.598482 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":79,"threads_started":1}
I20260808 17:52:44.599192 18481 heartbeater.cc:347] Connected to a master server at 127.28.213.190:44721
I20260808 17:52:44.599288 18481 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:44.599478 18481 heartbeater.cc:511] Master 127.28.213.190:44721 requested a full tablet report, sending...
I20260808 17:52:44.599961 18164 ts_manager.cc:194] Registered new tserver with Master: 635c62adb2ed40d0b9817fbb589789f1 (127.28.213.129:40761)
I20260808 17:52:44.600528 18164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:55905
WARNING: no policy specified for kudu/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
I20260808 17:52:44.617069 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:44721
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:52:44.694990 18491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:44.695165 18491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:44.695186 18491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:44.696238 18491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:44.696273 18491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:44.696297 18491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:52:44.697639 18491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:44721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:44.697800 18491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:44.697964 18491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:44.702406 18500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:44.702417 18498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:44.702574 18491 server_base.cc:1034] running on GCE node
W20260808 17:52:44.702497 18497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:44.702808 18491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:44.703027 18491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:44.704162 18491 hybrid_clock.cc:648] HybridClock initialized: now 1786211564704148 us; error 31 us; skew 500 ppm
Aug 08 17:52:44 dist-test-slave-bndk krb5kdc[18101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211564, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:44.706419 18491 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:52:44.706806 18491 webserver.cc:460] Webserver started at http://127.28.213.130:40219/ using document root <none> and password file <none>
I20260808 17:52:44.706998 18491 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:44.707046 18491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:44.707167 18491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:52:44.708104 18491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "13f66412d7334be280ee0e148d981072"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "ebc9752eaa1780cdca724b20ce9b1f62"
server_key_iv: "d93186a171cf4a1e1e65e60197c3eb02"
server_key_version: "encryptionkey@0"
I20260808 17:52:44.708410 18491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "13f66412d7334be280ee0e148d981072"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "ebc9752eaa1780cdca724b20ce9b1f62"
server_key_iv: "d93186a171cf4a1e1e65e60197c3eb02"
server_key_version: "encryptionkey@0"
I20260808 17:52:44.709601 18491 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:52:44.710209 18511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:44.710350 18491 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:52:44.710426 18491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "13f66412d7334be280ee0e148d981072"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "ebc9752eaa1780cdca724b20ce9b1f62"
server_key_iv: "d93186a171cf4a1e1e65e60197c3eb02"
server_key_version: "encryptionkey@0"
I20260808 17:52:44.710484 18491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:44.721246 18491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:44.722993 18491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:44.723114 18491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:44.723295 18491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:52:44.723551 18491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:52:44.723583 18491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:44.723609 18491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:52:44.723632 18491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:44.728978 18491 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:42327
I20260808 17:52:44.729012 18690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:42327 every 8 connection(s)
I20260808 17:52:44.729310 18491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:52:44.731187 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 18491
I20260808 17:52:44.731292 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:52:44.731458 29526 external_mini_cluster.cc:1428] Setting key c1e35f04803daae7e058610ae4b13548
Aug 08 17:52:44 dist-test-slave-bndk krb5kdc[18101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211564, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:52:44.738339 18232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:44.729909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:38347 (local address 127.28.213.190:44721)
0808 17:52:44.729968 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:44.729970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:44.730131 (+ 161us) server_negotiation.cc:407] Connection header received
0808 17:52:44.730587 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:44.730588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:44.730600 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:44.730650 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:44.731530 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.732233 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.733154 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.733424 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.733483 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:44.735664 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:44.735666 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:44.735666 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:44.735672 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:44.737021 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:44.737504 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:44.737505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:44.737505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:44.737554 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:44.737797 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:44.737798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:44.737798 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:44.737887 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:44.737929 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:44.738217 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 17:52:44.738279 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 17:52:44.738577 18694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:44.729868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:38347)
0808 17:52:44.730025 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:44.730056 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:44.730498 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:44.730712 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:44.730715 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:44.731228 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:44.731446 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:44.731451 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.732312 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.732313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:44.733075 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:44.733077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.733492 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.733493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:44.733632 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:44.734070 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:44.734080 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:44.735566 (+ 1486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:44.737100 (+ 1534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:44.737108 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:44.737110 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:44.737427 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:44.737609 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:44.737609 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:44.737610 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:44.737740 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:44.737937 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:44.737942 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:44.738093 (+ 151us) client_negotiation.cc:769] Sending connection context
0808 17:52:44.738201 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 17:52:44.738357 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":85,"threads_started":1}
I20260808 17:52:44.739024 18691 heartbeater.cc:347] Connected to a master server at 127.28.213.190:44721
I20260808 17:52:44.739106 18691 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:44.739259 18691 heartbeater.cc:511] Master 127.28.213.190:44721 requested a full tablet report, sending...
I20260808 17:52:44.739593 18164 ts_manager.cc:194] Registered new tserver with Master: 13f66412d7334be280ee0e148d981072 (127.28.213.130:42327)
I20260808 17:52:44.739913 18164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:38347
WARNING: no policy specified for kudu/127.28.213.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
I20260808 17:52:44.755631 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:44721
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:52:44.833768 18698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:44.833959 18698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:44.833990 18698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:44.835073 18698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:44.835112 18698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:44.835146 18698 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:52:44.836519 18698 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:44721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18698
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:44.836736 18698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:44.836934 18698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:44.841436 18704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:44.841499 18698 server_base.cc:1034] running on GCE node
W20260808 17:52:44.841444 18707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:44.841435 18703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:44.841814 18698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:44.842028 18698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:44.843168 18698 hybrid_clock.cc:648] HybridClock initialized: now 1786211564843153 us; error 27 us; skew 500 ppm
Aug 08 17:52:44 dist-test-slave-bndk krb5kdc[18101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211564, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:44.845391 18698 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:52:44.845803 18698 webserver.cc:460] Webserver started at http://127.28.213.131:36251/ using document root <none> and password file <none>
I20260808 17:52:44.845986 18698 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:44.846032 18698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:44.846153 18698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:52:44.847072 18698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "991a5aecdaf748ddaac3e7e93edda515"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "fe3b7702c46dae01e486bdd80d71106d"
server_key_iv: "e49144ca9adb38ff4ae375833e30c06a"
server_key_version: "encryptionkey@0"
I20260808 17:52:44.847381 18698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "991a5aecdaf748ddaac3e7e93edda515"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "fe3b7702c46dae01e486bdd80d71106d"
server_key_iv: "e49144ca9adb38ff4ae375833e30c06a"
server_key_version: "encryptionkey@0"
I20260808 17:52:44.848536 18698 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:52:44.849151 18717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:44.849309 18698 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:52:44.849397 18698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "991a5aecdaf748ddaac3e7e93edda515"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "fe3b7702c46dae01e486bdd80d71106d"
server_key_iv: "e49144ca9adb38ff4ae375833e30c06a"
server_key_version: "encryptionkey@0"
I20260808 17:52:44.849465 18698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:44.857275 18698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:44.858793 18698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:44.858916 18698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:44.859097 18698 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:52:44.859359 18698 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:52:44.859392 18698 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:44.859426 18698 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:52:44.859450 18698 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:44.864725 18698 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:45027
I20260808 17:52:44.864760 18897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:45027 every 8 connection(s)
I20260808 17:52:44.865020 18698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
Aug 08 17:52:44 dist-test-slave-bndk krb5kdc[18101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211564, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:52:44.873276 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 18698
I20260808 17:52:44.873378 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:52:44.873566 29526 external_mini_cluster.cc:1428] Setting key d4115d28ee47842bceac97f2275b3a47
I20260808 17:52:44.875916 18232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:44.865638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:59473 (local address 127.28.213.190:44721)
0808 17:52:44.865681 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:44.865683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:44.865845 (+ 162us) server_negotiation.cc:407] Connection header received
0808 17:52:44.866260 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:44.866261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:44.866271 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:44.866321 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:44.867115 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.867744 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.869106 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.869609 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.869694 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:44.872781 (+ 3087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:44.872783 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:44.872784 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:44.872791 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:44.874448 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:44.874885 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:44.874886 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:44.874886 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:44.874945 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:44.875219 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:44.875220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:44.875221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:44.875350 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:44.875388 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:44.875727 (+ 339us) server_negotiation.cc:299] Negotiation successful
0808 17:52:44.875825 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:52:44.876662 18900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:44.865597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:59473)
0808 17:52:44.865744 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:44.865781 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:44.866189 (+ 408us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:44.866368 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:44.866371 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:44.866875 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:44.867051 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:44.867055 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.867847 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.867848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:44.869004 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:44.869008 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.869783 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.869784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:44.869981 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:44.870505 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:44.870515 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:44.872682 (+ 2167us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:44.874534 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:44.874540 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:44.874542 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:44.874803 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:44.875009 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:44.875010 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:44.875010 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:44.875152 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:44.875441 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:44.875446 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:44.875587 (+ 141us) client_negotiation.cc:769] Sending connection context
0808 17:52:44.876289 (+ 702us) client_negotiation.cc:240] Negotiation successful
0808 17:52:44.876460 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":83,"threads_started":1}
I20260808 17:52:44.878369 18898 heartbeater.cc:347] Connected to a master server at 127.28.213.190:44721
I20260808 17:52:44.878471 18898 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:44.878625 18898 heartbeater.cc:511] Master 127.28.213.190:44721 requested a full tablet report, sending...
I20260808 17:52:44.879014 18164 ts_manager.cc:194] Registered new tserver with Master: 991a5aecdaf748ddaac3e7e93edda515 (127.28.213.131:45027)
I20260808 17:52:44.879477 18164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:59473
I20260808 17:52:44.890102 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:52:44.898006 18232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:44.891551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47304 (local address 127.28.213.190:44721)
0808 17:52:44.891589 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:44.891591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:44.891754 (+ 163us) server_negotiation.cc:407] Connection header received
0808 17:52:44.891809 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:44.891810 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:44.891820 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:44.891874 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:44.892572 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.893028 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.893802 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.894045 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.894101 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:44.895423 (+ 1322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:44.895424 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:44.895425 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:44.895431 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:44.896730 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:44.897085 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:44.897087 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:44.897087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:44.897167 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:44.897387 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:44.897388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:44.897388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:44.897610 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:44.897723 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:44.897821 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 17:52:44.897909 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:52:44.900044 18164 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47304:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:52:44.902240 18164 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:52:44.909559 18913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:44.904286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:40761 (local address 127.0.0.1:42934)
0808 17:52:44.904994 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:44.905004 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:44.905056 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:44.905557 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:44.905558 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:44.905560 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:52:44.905604 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:44.905605 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.906821 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.906822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:44.908095 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:44.908097 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.909316 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.909319 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:44.909381 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:44.909385 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:52:44.909447 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 17:52:44.909486 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"mutex_wait_us":94,"thread_start_us":53,"threads_started":1}
I20260808 17:52:44.909838 18916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:44.904542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42934 (local address 127.28.213.129:40761)
0808 17:52:44.904951 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:44.904955 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:44.905065 (+ 110us) server_negotiation.cc:407] Connection header received
0808 17:52:44.905456 (+ 391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:44.905460 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:44.905478 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:44.905555 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:52:44.905689 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.906721 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.908187 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.908999 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.909062 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:44.909116 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:44.909725 (+ 609us) server_negotiation.cc:299] Negotiation successful
0808 17:52:44.909764 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":77,"threads_started":1}
I20260808 17:52:44.910035 18910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:44.904292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:45027 (local address 127.0.0.1:38530)
0808 17:52:44.904657 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:44.904669 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:44.904733 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:44.904939 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:44.904942 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:44.904944 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:52:44.905008 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:44.905009 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.906867 (+ 1858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.906868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:44.908094 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:44.908097 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.909097 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.909098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:44.909190 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:44.909207 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 17:52:44.909292 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 17:52:44.909839 (+ 547us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"mutex_wait_us":17,"thread_start_us":52,"threads_started":1}
I20260808 17:52:44.910188 18914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:44.904286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:42327 (local address 127.0.0.1:35896)
0808 17:52:44.904480 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:44.904518 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:44.904575 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:44.905254 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:44.905254 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:44.905256 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:52:44.905294 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:44.905295 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.906543 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.906544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:44.908990 (+ 2446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:44.908994 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.909964 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.909965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:44.910033 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:44.910037 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:52:44.910085 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 17:52:44.910121 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":18,"thread_start_us":61,"threads_started":1}
I20260808 17:52:44.910475 18917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:44.904732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35896 (local address 127.28.213.130:42327)
0808 17:52:44.905092 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:44.905097 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:44.905107 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:52:44.905147 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:44.905149 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:44.905165 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:44.905258 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:52:44.905367 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.906431 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.909085 (+ 2654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.909799 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.909859 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:44.909924 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:44.910357 (+ 433us) server_negotiation.cc:299] Negotiation successful
0808 17:52:44.910399 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":86,"threads_started":1}
I20260808 17:52:44.910485 18362 tablet_service.cc:1467] Processing CreateTablet for tablet 29c8e854c3fb43e79643c73a4afc656b (DEFAULT_TABLE table=test-table [id=73187ee13a174b148eabbd0da3d3b622]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:52:44.910818 18915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:44.904514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38530 (local address 127.28.213.131:45027)
0808 17:52:44.904679 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:44.904684 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:44.904721 (+ 37us) server_negotiation.cc:407] Connection header received
0808 17:52:44.904817 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:44.904819 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:44.904835 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:44.904908 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:52:44.905646 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.906731 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.908175 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:44.908992 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:44.910436 (+ 1444us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:44.910502 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:44.910687 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 17:52:44.910730 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":81,"threads_started":1}
I20260808 17:52:44.910849 18362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29c8e854c3fb43e79643c73a4afc656b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:52:44.911116 18591 tablet_service.cc:1467] Processing CreateTablet for tablet 29c8e854c3fb43e79643c73a4afc656b (DEFAULT_TABLE table=test-table [id=73187ee13a174b148eabbd0da3d3b622]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:52:44.911469 18591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29c8e854c3fb43e79643c73a4afc656b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:52:44.911610 18803 tablet_service.cc:1467] Processing CreateTablet for tablet 29c8e854c3fb43e79643c73a4afc656b (DEFAULT_TABLE table=test-table [id=73187ee13a174b148eabbd0da3d3b622]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:52:44.911922 18803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29c8e854c3fb43e79643c73a4afc656b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:52:44.913489 18920 tablet_bootstrap.cc:492] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1: Bootstrap starting.
I20260808 17:52:44.914149 18920 tablet_bootstrap.cc:654] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1: Neither blocks nor log segments found. Creating new log.
I20260808 17:52:44.914582 18920 log.cc:824] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1: Log is configured to *not* fsync() on all Append() calls
I20260808 17:52:44.914705 18921 tablet_bootstrap.cc:492] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072: Bootstrap starting.
I20260808 17:52:44.915112 18925 tablet_bootstrap.cc:492] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515: Bootstrap starting.
I20260808 17:52:44.915321 18921 tablet_bootstrap.cc:654] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072: Neither blocks nor log segments found. Creating new log.
I20260808 17:52:44.915755 18925 tablet_bootstrap.cc:654] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515: Neither blocks nor log segments found. Creating new log.
I20260808 17:52:44.915879 18921 log.cc:824] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072: Log is configured to *not* fsync() on all Append() calls
I20260808 17:52:44.916271 18925 log.cc:824] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515: Log is configured to *not* fsync() on all Append() calls
I20260808 17:52:44.916661 18920 tablet_bootstrap.cc:492] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1: No bootstrap required, opened a new log
I20260808 17:52:44.916733 18920 ts_tablet_manager.cc:1397] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 17:52:44.917047 18925 tablet_bootstrap.cc:492] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515: No bootstrap required, opened a new log
I20260808 17:52:44.917110 18925 ts_tablet_manager.cc:1397] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:52:44.918635 18920 raft_consensus.cc:348] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } }
I20260808 17:52:44.918799 18920 raft_consensus.cc:374] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:52:44.918833 18920 raft_consensus.cc:729] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 635c62adb2ed40d0b9817fbb589789f1, State: Initialized, Role: FOLLOWER
I20260808 17:52:44.918931 18925 raft_consensus.cc:348] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } }
I20260808 17:52:44.919082 18925 raft_consensus.cc:374] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:52:44.919124 18925 raft_consensus.cc:729] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 991a5aecdaf748ddaac3e7e93edda515, State: Initialized, Role: FOLLOWER
I20260808 17:52:44.919268 18921 tablet_bootstrap.cc:492] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072: No bootstrap required, opened a new log
I20260808 17:52:44.919238 18925 consensus_queue.cc:260] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } }
I20260808 17:52:44.919333 18921 ts_tablet_manager.cc:1397] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260808 17:52:44.919515 18925 ts_tablet_manager.cc:1428] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:52:44.919545 18898 heartbeater.cc:503] Master 127.28.213.190:44721 was elected leader, sending a full tablet report...
I20260808 17:52:44.921314 18920 consensus_queue.cc:260] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } }
I20260808 17:52:44.921276 18921 raft_consensus.cc:348] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } }
I20260808 17:52:44.921427 18921 raft_consensus.cc:374] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:52:44.921468 18921 raft_consensus.cc:729] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f66412d7334be280ee0e148d981072, State: Initialized, Role: FOLLOWER
I20260808 17:52:44.921572 18921 consensus_queue.cc:260] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } }
I20260808 17:52:44.921782 18920 ts_tablet_manager.cc:1428] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260808 17:52:44.921818 18481 heartbeater.cc:503] Master 127.28.213.190:44721 was elected leader, sending a full tablet report...
I20260808 17:52:44.922065 18921 ts_tablet_manager.cc:1428] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:52:44.922171 18691 heartbeater.cc:503] Master 127.28.213.190:44721 was elected leader, sending a full tablet report...
W20260808 17:52:44.979787 18693 tablet.cc:2369] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:52:45.090171 18483 tablet.cc:2369] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:52:45.115502 18899 tablet.cc:2369] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:52:45.304576 18937 raft_consensus.cc:482] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:52:45.304699 18937 raft_consensus.cc:504] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } }
I20260808 17:52:45.305089 18937 leader_election.cc:288] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 991a5aecdaf748ddaac3e7e93edda515 (127.28.213.131:45027), 635c62adb2ed40d0b9817fbb589789f1 (127.28.213.129:40761)
I20260808 17:52:45.307891 18915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.305376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:41857 (local address 127.28.213.131:45027)
0808 17:52:45.305439 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:45.305441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:45.305518 (+ 77us) server_negotiation.cc:407] Connection header received
0808 17:52:45.305586 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:45.305587 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:45.305597 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:45.305642 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:52:45.305781 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.306243 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.307162 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.307542 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.307603 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:45.307634 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:45.307783 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 17:52:45.307823 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 17:52:45.307897 18940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.305292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:45027 (local address 127.28.213.130:41857)
0808 17:52:45.305448 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:45.305459 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:45.305526 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:45.305652 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:45.305652 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:45.305655 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:52:45.305725 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:45.305726 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.306311 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.306312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:45.307078 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:45.307080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.307621 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.307622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:45.307709 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:45.307713 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:52:45.307762 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 17:52:45.307803 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":77,"threads_started":1}
I20260808 17:52:45.307950 18916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.305379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:39323 (local address 127.28.213.129:40761)
0808 17:52:45.305429 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:45.305431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:45.305610 (+ 179us) server_negotiation.cc:407] Connection header received
0808 17:52:45.305657 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:45.305658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:45.305668 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:45.305713 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:52:45.305858 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.306344 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.307223 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.307661 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.307725 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:45.307733 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:45.307854 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 17:52:45.307890 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:52:45.308138 18939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.305297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:40761 (local address 127.28.213.130:39323)
0808 17:52:45.305465 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:45.305512 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:45.305597 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:45.305722 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:45.305722 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:45.305724 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:52:45.305797 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:45.305799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.306415 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.306416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:45.307140 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:45.307142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.307736 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.307737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:45.307796 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:45.307798 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:52:45.307844 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 17:52:45.307872 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":61,"threads_started":1}
I20260808 17:52:45.308317 18828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29c8e854c3fb43e79643c73a4afc656b" candidate_uuid: "13f66412d7334be280ee0e148d981072" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "991a5aecdaf748ddaac3e7e93edda515" is_pre_election: true
I20260808 17:52:45.308462 18391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29c8e854c3fb43e79643c73a4afc656b" candidate_uuid: "13f66412d7334be280ee0e148d981072" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "635c62adb2ed40d0b9817fbb589789f1" is_pre_election: true
I20260808 17:52:45.308506 18828 raft_consensus.cc:2454] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13f66412d7334be280ee0e148d981072 in term 0.
I20260808 17:52:45.308624 18391 raft_consensus.cc:2454] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13f66412d7334be280ee0e148d981072 in term 0.
I20260808 17:52:45.308780 18515 leader_election.cc:302] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f66412d7334be280ee0e148d981072, 991a5aecdaf748ddaac3e7e93edda515; no voters:
I20260808 17:52:45.308939 18937 raft_consensus.cc:2781] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:52:45.308998 18937 raft_consensus.cc:482] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:52:45.309022 18937 raft_consensus.cc:3037] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:52:45.309760 18937 raft_consensus.cc:504] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } }
I20260808 17:52:45.309885 18937 leader_election.cc:288] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [CANDIDATE]: Term 1 election: Requested vote from peers 991a5aecdaf748ddaac3e7e93edda515 (127.28.213.131:45027), 635c62adb2ed40d0b9817fbb589789f1 (127.28.213.129:40761)
I20260808 17:52:45.310041 18391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29c8e854c3fb43e79643c73a4afc656b" candidate_uuid: "13f66412d7334be280ee0e148d981072" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "635c62adb2ed40d0b9817fbb589789f1"
I20260808 17:52:45.310068 18828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29c8e854c3fb43e79643c73a4afc656b" candidate_uuid: "13f66412d7334be280ee0e148d981072" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "991a5aecdaf748ddaac3e7e93edda515"
I20260808 17:52:45.310109 18391 raft_consensus.cc:3037] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:52:45.310137 18828 raft_consensus.cc:3037] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:52:45.310815 18828 raft_consensus.cc:2454] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f66412d7334be280ee0e148d981072 in term 1.
I20260808 17:52:45.310854 18391 raft_consensus.cc:2454] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f66412d7334be280ee0e148d981072 in term 1.
I20260808 17:52:45.310976 18515 leader_election.cc:302] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f66412d7334be280ee0e148d981072, 991a5aecdaf748ddaac3e7e93edda515; no voters:
I20260808 17:52:45.311077 18937 raft_consensus.cc:2781] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:52:45.311239 18937 raft_consensus.cc:686] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [term 1 LEADER]: Becoming Leader. State: Replica: 13f66412d7334be280ee0e148d981072, State: Running, Role: LEADER
I20260808 17:52:45.311411 18937 consensus_queue.cc:237] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } }
I20260808 17:52:45.312208 18164 catalog_manager.cc:5495] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13f66412d7334be280ee0e148d981072 (127.28.213.130). New cstate: current_term: 1 leader_uuid: "13f66412d7334be280ee0e148d981072" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } health_report { overall_health: HEALTHY } } }
I20260808 17:52:45.347599 18917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.345362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35900 (local address 127.28.213.130:42327)
0808 17:52:45.345419 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:45.345421 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:45.345430 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:52:45.345475 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:45.345476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:45.345494 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:45.345556 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:52:45.345680 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.346142 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.346878 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.347065 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.347122 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:45.347276 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:52:45.347377 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:52:45.347457 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:45.347496 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 17:52:45.347518 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:52:45.349380 18391 raft_consensus.cc:1261] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Refusing update from remote peer 13f66412d7334be280ee0e148d981072: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:52:45.349386 18828 raft_consensus.cc:1261] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515 [term 1 FOLLOWER]: Refusing update from remote peer 13f66412d7334be280ee0e148d981072: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:52:45.349740 18941 consensus_queue.cc:1035] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [LEADER]: Connected to new peer: Peer: permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:52:45.349846 18937 consensus_queue.cc:1035] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [LEADER]: Connected to new peer: Peer: permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:52:45.352567 18947 mvcc.cc:205] Tried to move back new op lower bound from 7316322571668361216 to 7316322571516153856. Current Snapshot: MvccSnapshot[applied={T|T < 7316322571668361216}]
I20260808 17:52:45.352922 18946 mvcc.cc:205] Tried to move back new op lower bound from 7316322571668361216 to 7316322571516153856. Current Snapshot: MvccSnapshot[applied={T|T < 7316322571668361216}]
I20260808 17:52:45.354636 18164 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47304:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:52:45.354733 18164 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47304:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:52:45.355445 18164 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92: Sending DeleteTablet for 3 replicas of tablet 29c8e854c3fb43e79643c73a4afc656b
I20260808 17:52:45.355772 18362 tablet_service.cc:1514] Processing DeleteTablet for tablet 29c8e854c3fb43e79643c73a4afc656b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:52:45 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:42934
I20260808 17:52:45.355822 18803 tablet_service.cc:1514] Processing DeleteTablet for tablet 29c8e854c3fb43e79643c73a4afc656b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:52:45 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:38530
I20260808 17:52:45.355844 18591 tablet_service.cc:1514] Processing DeleteTablet for tablet 29c8e854c3fb43e79643c73a4afc656b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:52:45 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:35896
I20260808 17:52:45.356031 18960 tablet_replica.cc:330] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072: stopping tablet replica
I20260808 17:52:45.356108 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 18263
I20260808 17:52:45.356129 18960 raft_consensus.cc:2229] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:52:45.356212 18960 raft_consensus.cc:2258] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:52:45.356462 18961 tablet_replica.cc:330] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515: stopping tablet replica
I20260808 17:52:45.356591 18961 raft_consensus.cc:2229] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:52:45.356730 18961 raft_consensus.cc:2258] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:52:45.361033 18960 ts_tablet_manager.cc:1905] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:52:45.361778 18961 ts_tablet_manager.cc:1905] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:52:45.363824 18960 ts_tablet_manager.cc:1918] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:52:45.365863 18961 ts_tablet_manager.cc:1918] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:52:45.366029 18960 log.cc:1196] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/29c8e854c3fb43e79643c73a4afc656b
I20260808 17:52:45.366170 18961 log.cc:1196] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/29c8e854c3fb43e79643c73a4afc656b
I20260808 17:52:45.366631 18960 ts_tablet_manager.cc:1939] T 29c8e854c3fb43e79643c73a4afc656b P 13f66412d7334be280ee0e148d981072: Deleting consensus metadata
I20260808 17:52:45.366990 18961 ts_tablet_manager.cc:1939] T 29c8e854c3fb43e79643c73a4afc656b P 991a5aecdaf748ddaac3e7e93edda515: Deleting consensus metadata
I20260808 17:52:45.367501 18146 catalog_manager.cc:4841] TS 991a5aecdaf748ddaac3e7e93edda515 (127.28.213.131:45027): tablet 29c8e854c3fb43e79643c73a4afc656b (table test-table [id=73187ee13a174b148eabbd0da3d3b622]) successfully deleted
I20260808 17:52:45.367995 18144 catalog_manager.cc:4841] TS 13f66412d7334be280ee0e148d981072 (127.28.213.130:42327): tablet 29c8e854c3fb43e79643c73a4afc656b (table test-table [id=73187ee13a174b148eabbd0da3d3b622]) successfully deleted
W20260808 17:52:45.378286 18147 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.213.129:40761 (error 108)
I20260808 17:52:45.378458 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 18491
I20260808 17:52:45.378820 18913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.378683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:40761 (local address 127.0.0.1:42948)
0808 17:52:45.378745 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:45.378781 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.129:40761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 17:52:45.379030 18147 catalog_manager.cc:4584] TS 635c62adb2ed40d0b9817fbb589789f1 (127.28.213.129:40761): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 29c8e854c3fb43e79643c73a4afc656b: Network error: Client connection negotiation failed: client connection to 127.28.213.129:40761: connect: Connection refused (error 111)
I20260808 17:52:45.386229 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 18698
I20260808 17:52:45.398626 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 18123
I20260808 17:52:45.408624 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:44721
--webserver_interface=127.28.213.190
--webserver_port=37621
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:44721
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:52:45.487854 18967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:45.488040 18967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:45.488060 18967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:45.489100 18967 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:52:45.489131 18967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:45.489145 18967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:45.489156 18967 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:52:45.489171 18967 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:52:45.490644 18967 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:44721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:44721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=37621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18967
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:45.490824 18967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:45.490996 18967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:45.499523 18975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:45.499508 18980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:45.499543 18967 server_base.cc:1034] running on GCE node
W20260808 17:52:45.499511 18985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:45.500000 18967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:45.500295 18967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:45.501430 18967 hybrid_clock.cc:648] HybridClock initialized: now 1786211565501418 us; error 25 us; skew 500 ppm
Aug 08 17:52:45 dist-test-slave-bndk krb5kdc[18101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211565, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:45.508502 18967 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:52:45.508947 18967 webserver.cc:460] Webserver started at http://127.28.213.190:37621/ using document root <none> and password file <none>
I20260808 17:52:45.509157 18967 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:45.509239 18967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:45.510509 18967 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:52:45.511096 18994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:45.511240 18967 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:52:45.511335 18967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "59ebcde977bb4cc0bb44103201cdac92"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "937ff6a04f7377ce69b7ac51b9a30658"
server_key_iv: "e4cd0a5505afd89e0a984391df89dc0a"
server_key_version: "encryptionkey@0"
I20260808 17:52:45.511739 18967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:45.537480 18967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:45.539121 18967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:45.539247 18967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:45.543210 18967 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:44721
I20260808 17:52:45.543252 19058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:44721 every 8 connection(s)
I20260808 17:52:45.543612 18967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:52:45.545203 19059 sys_catalog.cc:263] Verifying existing consensus state
I20260808 17:52:45.545845 19059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92: Bootstrap starting.
I20260808 17:52:45.553468 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 18967
I20260808 17:52:45.553728 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:40761
--local_ip_for_outbound_sockets=127.28.213.129
--tserver_master_addrs=127.28.213.190:44721
--webserver_port=33449
--webserver_interface=127.28.213.129
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:52:45.554054 19059 log.cc:824] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92: Log is configured to *not* fsync() on all Append() calls
I20260808 17:52:45.556138 19059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:52:45.556444 19059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92: Bootstrap complete.
I20260808 17:52:45.558558 19059 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ebcde977bb4cc0bb44103201cdac92" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44721 } }
I20260808 17:52:45.558769 19059 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59ebcde977bb4cc0bb44103201cdac92, State: Initialized, Role: FOLLOWER
I20260808 17:52:45.558915 19059 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ebcde977bb4cc0bb44103201cdac92" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44721 } }
I20260808 17:52:45.558977 19059 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:52:45.559011 19059 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:52:45.559059 19059 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 1 FOLLOWER]: Advancing to term 2
I20260808 17:52:45.560012 19059 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ebcde977bb4cc0bb44103201cdac92" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44721 } }
I20260808 17:52:45.560099 19059 leader_election.cc:302] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59ebcde977bb4cc0bb44103201cdac92; no voters:
I20260808 17:52:45.560248 19059 leader_election.cc:288] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 17:52:45.560300 19064 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 17:52:45.560428 19064 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 2 LEADER]: Becoming Leader. State: Replica: 59ebcde977bb4cc0bb44103201cdac92, State: Running, Role: LEADER
I20260808 17:52:45.560506 19059 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:52:45.560581 19064 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ebcde977bb4cc0bb44103201cdac92" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44721 } }
I20260808 17:52:45.560917 19064 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59ebcde977bb4cc0bb44103201cdac92. Latest consensus state: current_term: 2 leader_uuid: "59ebcde977bb4cc0bb44103201cdac92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ebcde977bb4cc0bb44103201cdac92" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44721 } } }
I20260808 17:52:45.560992 19064 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [sys.catalog]: This master's current role is: LEADER
I20260808 17:52:45.561411 19068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "59ebcde977bb4cc0bb44103201cdac92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ebcde977bb4cc0bb44103201cdac92" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44721 } } }
I20260808 17:52:45.561493 19068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [sys.catalog]: This master's current role is: LEADER
I20260808 17:52:45.561524 19076 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:52:45.562332 19076 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:52:45.562495 19076 catalog_manager.cc:1259] Loaded cluster ID: 0e01015f3f624576bd8757806ba99fff
I20260808 17:52:45.562712 19076 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:52:45.562927 19076 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 17:52:45.566287 19076 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 17:52:45.568450 19076 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:52:45.568635 19076 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92: Loaded TSK: 0
I20260808 17:52:45.568866 19076 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 17:52:45.634692 19063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:45.634888 19063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:45.634922 19063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:45.636029 19063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:45.636066 19063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:45.636090 19063 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:52:45.637519 19063 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:40761
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=33449
--tserver_master_addrs=127.28.213.190:44721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19063
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:45.637737 19063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:45.637950 19063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:45.643551 19100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:45.643530 19103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:45.643537 19107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:45.644114 19063 server_base.cc:1034] running on GCE node
I20260808 17:52:45.644286 19063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:45.644496 19063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:45.645630 19063 hybrid_clock.cc:648] HybridClock initialized: now 1786211565645617 us; error 30 us; skew 500 ppm
Aug 08 17:52:45 dist-test-slave-bndk krb5kdc[18101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211565, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:45.647945 19063 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:52:45.648345 19063 webserver.cc:460] Webserver started at http://127.28.213.129:33449/ using document root <none> and password file <none>
I20260808 17:52:45.648552 19063 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:45.648613 19063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:45.649983 19063 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260808 17:52:45.650609 19121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:45.650768 19063 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:52:45.650851 19063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "635c62adb2ed40d0b9817fbb589789f1"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "50283a05bb06f91accf7ce1c2b5f12cf"
server_key_iv: "397143afbcb581ff8f6e203b83f86e46"
server_key_version: "encryptionkey@0"
I20260808 17:52:45.651175 19063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:45.657774 19063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:45.659813 19063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:45.659948 19063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:45.660135 19063 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:52:45.660588 19130 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 17:52:45.662631 19063 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 17:52:45.662676 19063 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 17:52:45.662707 19063 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 17:52:45.663296 19063 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 17:52:45.663329 19063 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 17:52:45.663410 19130 tablet_bootstrap.cc:492] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1: Bootstrap starting.
I20260808 17:52:45.669857 19063 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:40761
I20260808 17:52:45.670223 19063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:52:45.674072 19130 log.cc:824] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1: Log is configured to *not* fsync() on all Append() calls
I20260808 17:52:45.675246 19293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:40761 every 8 connection(s)
I20260808 17:52:45.676376 19130 tablet_bootstrap.cc:492] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:52:45.676623 19130 tablet_bootstrap.cc:492] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1: Bootstrap complete.
I20260808 17:52:45.677412 19130 ts_tablet_manager.cc:1397] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.009s
I20260808 17:52:45.678612 19130 raft_consensus.cc:348] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } }
I20260808 17:52:45.678906 19130 raft_consensus.cc:729] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 635c62adb2ed40d0b9817fbb589789f1, State: Initialized, Role: FOLLOWER
I20260808 17:52:45.679028 19130 consensus_queue.cc:260] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } }
I20260808 17:52:45.679430 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 19063
I20260808 17:52:45.679673 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:42327
--local_ip_for_outbound_sockets=127.28.213.130
--tserver_master_addrs=127.28.213.190:44721
--webserver_port=40219
--webserver_interface=127.28.213.130
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:52:45.681293 19130 ts_tablet_manager.cc:1428] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
Aug 08 17:52:45 dist-test-slave-bndk krb5kdc[18101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211565, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:52:45.686343 19296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.670802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:48559)
0808 17:52:45.674341 (+ 3539us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:45.674385 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:45.674988 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:45.675579 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:45.675583 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:45.675940 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:45.676203 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:45.676208 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.677849 (+ 1641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.677850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:45.679039 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:45.679042 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.679866 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.679867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:45.680018 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:45.680553 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:45.680573 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:45.682313 (+ 1740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:45.684457 (+ 2144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:45.684465 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:45.684467 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:45.684755 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:45.685064 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:45.685065 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:45.685065 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:45.685199 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:45.685699 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:45.685707 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:45.685873 (+ 166us) client_negotiation.cc:769] Sending connection context
0808 17:52:45.685984 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 17:52:45.686145 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3500,"thread_start_us":84,"threads_started":1}
I20260808 17:52:45.686408 19299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.670937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:48559 (local address 127.28.213.190:44721)
0808 17:52:45.671088 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:45.671097 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:45.674517 (+ 3420us) server_negotiation.cc:407] Connection header received
0808 17:52:45.675220 (+ 703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:45.675227 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:45.675286 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:45.675430 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:45.676335 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.677757 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.679177 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.679764 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.680307 (+ 543us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:45.682432 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:45.682436 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:45.682436 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:45.682449 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:45.684350 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:45.684847 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:45.684851 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:45.684852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:45.684981 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:45.685306 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:45.685308 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:45.685308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:45.685612 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:45.685703 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:45.686076 (+ 373us) server_negotiation.cc:299] Negotiation successful
0808 17:52:45.686218 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":79,"threads_started":1}
I20260808 17:52:45.687175 19294 heartbeater.cc:347] Connected to a master server at 127.28.213.190:44721
I20260808 17:52:45.687260 19294 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:45.687449 19294 heartbeater.cc:511] Master 127.28.213.190:44721 requested a full tablet report, sending...
I20260808 17:52:45.688228 19013 ts_manager.cc:194] Registered new tserver with Master: 635c62adb2ed40d0b9817fbb589789f1 (127.28.213.129:40761)
I20260808 17:52:45.689431 19013 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:48559
I20260808 17:52:45.690438 19294 heartbeater.cc:503] Master 127.28.213.190:44721 was elected leader, sending a full tablet report...
Aug 08 17:52:45 dist-test-slave-bndk krb5kdc[18101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211565, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for kudu/127.28.213.129@KRBTEST.COM
I20260808 17:52:45.701638 19308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.688857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:40761 (local address 127.0.0.1:42962)
0808 17:52:45.689280 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:45.689313 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:45.689377 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:45.689598 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:45.689601 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:45.693811 (+ 4210us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:45.693870 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:45.693900 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.695446 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.695447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:45.696383 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:45.696386 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.696910 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.696911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:45.696994 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:45.697480 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:45.697485 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:45.698857 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:45.700549 (+ 1692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:45.700556 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:45.700558 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:45.700747 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:45.700945 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:45.700946 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:45.700946 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:45.701003 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:45.701285 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:45.701303 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:45.701359 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 17:52:45.701425 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 17:52:45.701539 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":71,"threads_started":1}
I20260808 17:52:45.701647 19310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.689053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42962 (local address 127.28.213.129:40761)
0808 17:52:45.689199 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:45.689203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:45.689445 (+ 242us) server_negotiation.cc:407] Connection header received
0808 17:52:45.689478 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:45.689480 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:45.689494 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:45.689546 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:45.694011 (+ 4465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.695353 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.696481 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.696834 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.696896 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:45.698941 (+ 2045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:45.698948 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:45.698948 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:45.698956 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:45.700470 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:45.700834 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:45.700837 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:45.700837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:45.700890 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:45.701060 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:45.701061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:45.701062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:45.701199 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:45.701306 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:45.701485 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 17:52:45.701567 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":66,"threads_started":1}
I20260808 17:52:45.702000 19188 tablet_service.cc:1514] Processing DeleteTablet for tablet 29c8e854c3fb43e79643c73a4afc656b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:52:45 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:42962
I20260808 17:52:45.702481 19312 tablet_replica.cc:330] stopping tablet replica
I20260808 17:52:45.702570 19312 raft_consensus.cc:2229] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:52:45.702641 19312 raft_consensus.cc:2258] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:52:45.702936 19312 ts_tablet_manager.cc:1905] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:52:45.704893 19312 ts_tablet_manager.cc:1918] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:52:45.704972 19312 log.cc:1196] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/wal/wals/29c8e854c3fb43e79643c73a4afc656b
I20260808 17:52:45.705183 19312 ts_tablet_manager.cc:1939] T 29c8e854c3fb43e79643c73a4afc656b P 635c62adb2ed40d0b9817fbb589789f1: Deleting consensus metadata
I20260808 17:52:45.705662 18999 catalog_manager.cc:4841] TS 635c62adb2ed40d0b9817fbb589789f1 (127.28.213.129:40761): tablet 29c8e854c3fb43e79643c73a4afc656b (table test-table [id=73187ee13a174b148eabbd0da3d3b622]) successfully deleted
W20260808 17:52:45.764568 19306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:45.764763 19306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:45.764791 19306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:45.765967 19306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:45.766009 19306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:45.766043 19306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:52:45.767439 19306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:42327
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=40219
--tserver_master_addrs=127.28.213.190:44721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:45.767674 19306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:45.767876 19306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:45.772486 19317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:45.772526 19318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:45.772513 19322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:45.772655 19306 server_base.cc:1034] running on GCE node
I20260808 17:52:45.772825 19306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:45.773042 19306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:45.774173 19306 hybrid_clock.cc:648] HybridClock initialized: now 1786211565774159 us; error 23 us; skew 500 ppm
Aug 08 17:52:45 dist-test-slave-bndk krb5kdc[18101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211565, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:45.776448 19306 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:52:45.776825 19306 webserver.cc:460] Webserver started at http://127.28.213.130:40219/ using document root <none> and password file <none>
I20260808 17:52:45.777036 19306 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:45.777096 19306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:45.778337 19306 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:52:45.778853 19330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:45.778997 19306 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:45.779089 19306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "13f66412d7334be280ee0e148d981072"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "ebc9752eaa1780cdca724b20ce9b1f62"
server_key_iv: "d93186a171cf4a1e1e65e60197c3eb02"
server_key_version: "encryptionkey@0"
I20260808 17:52:45.779382 19306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:45.799573 19306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:45.801250 19306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:45.801378 19306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:45.801579 19306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:52:45.801848 19306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:52:45.801888 19306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:45.801918 19306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:52:45.801940 19306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:45.807385 19306 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:42327
I20260808 17:52:45.807420 19489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:42327 every 8 connection(s)
I20260808 17:52:45.807720 19306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
Aug 08 17:52:45 dist-test-slave-bndk krb5kdc[18101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211565, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:52:45.815514 19299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.808319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:50643 (local address 127.28.213.190:44721)
0808 17:52:45.808366 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:45.808368 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:45.808572 (+ 204us) server_negotiation.cc:407] Connection header received
0808 17:52:45.809003 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:45.809005 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:45.809014 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:45.809058 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:45.809934 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.810433 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.811322 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.811527 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.811572 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:45.813370 (+ 1798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:45.813371 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:45.813371 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:45.813378 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:45.814476 (+ 1098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:45.814786 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:45.814786 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:45.814787 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:45.814830 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:45.814987 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:45.814988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:45.814988 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:45.815096 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:45.815140 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:45.815365 (+ 225us) server_negotiation.cc:299] Negotiation successful
0808 17:52:45.815433 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:52:45.815650 19495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.808324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:50643)
0808 17:52:45.808468 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:45.808499 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:45.808932 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:45.809115 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:45.809118 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:45.809680 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:45.809856 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:45.809860 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.810499 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.810500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:45.811250 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:45.811252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.811582 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.811583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:45.811675 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:45.812030 (+ 355us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:45.812037 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:45.813283 (+ 1246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:45.814532 (+ 1249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:45.814538 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:45.814540 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:45.814732 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:45.814865 (+ 133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:45.814865 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:45.814865 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:45.814949 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:45.815144 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:45.815148 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:45.815249 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 17:52:45.815355 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 17:52:45.815472 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":82,"threads_started":1}
I20260808 17:52:45.815739 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 19306
I20260808 17:52:45.816027 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:45027
--local_ip_for_outbound_sockets=127.28.213.131
--tserver_master_addrs=127.28.213.190:44721
--webserver_port=36251
--webserver_interface=127.28.213.131
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:52:45.816033 19492 heartbeater.cc:347] Connected to a master server at 127.28.213.190:44721
I20260808 17:52:45.816112 19492 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:45.816273 19492 heartbeater.cc:511] Master 127.28.213.190:44721 requested a full tablet report, sending...
I20260808 17:52:45.816646 19013 ts_manager.cc:194] Registered new tserver with Master: 13f66412d7334be280ee0e148d981072 (127.28.213.130:42327)
I20260808 17:52:45.816998 19013 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:50643
W20260808 17:52:45.896129 19496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:45.896399 19496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:45.896445 19496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:45.897612 19496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:45.897650 19496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:45.897675 19496 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:52:45.899019 19496 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:45027
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=36251
--tserver_master_addrs=127.28.213.190:44721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19496
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:45.899183 19496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:45.899356 19496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:45.903875 19502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:45.903867 19506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:45.903867 19501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:45.903986 19496 server_base.cc:1034] running on GCE node
I20260808 17:52:45.904227 19496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:45.904449 19496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:45.905579 19496 hybrid_clock.cc:648] HybridClock initialized: now 1786211565905566 us; error 27 us; skew 500 ppm
Aug 08 17:52:45 dist-test-slave-bndk krb5kdc[18101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211565, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:45.907893 19496 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:52:45.908265 19496 webserver.cc:460] Webserver started at http://127.28.213.131:36251/ using document root <none> and password file <none>
I20260808 17:52:45.908447 19496 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:45.908509 19496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:45.909755 19496 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:52:45.910238 19520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:45.910380 19496 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:45.910459 19496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "991a5aecdaf748ddaac3e7e93edda515"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "fe3b7702c46dae01e486bdd80d71106d"
server_key_iv: "e49144ca9adb38ff4ae375833e30c06a"
server_key_version: "encryptionkey@0"
I20260808 17:52:45.910732 19496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:45.929822 19496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:45.931458 19496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:45.931558 19496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:45.931711 19496 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:52:45.931924 19496 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:52:45.931951 19496 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:45.931969 19496 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:52:45.931985 19496 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:45.937124 19496 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:45027
I20260808 17:52:45.937162 19689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:45027 every 8 connection(s)
I20260808 17:52:45.937472 19496 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:52:45.941380 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 19496
Aug 08 17:52:45 dist-test-slave-bndk krb5kdc[18101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211565, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:52:45.946839 19299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.938210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:50029 (local address 127.28.213.190:44721)
0808 17:52:45.938254 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:45.938256 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:45.938572 (+ 316us) server_negotiation.cc:407] Connection header received
0808 17:52:45.939165 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:45.939166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:45.939179 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:45.939245 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:45.940256 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.940999 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.942189 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.942376 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.942433 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:45.944419 (+ 1986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:45.944420 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:45.944421 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:45.944428 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:45.945616 (+ 1188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:45.945977 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:45.945978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:45.945978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:45.946021 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:45.946255 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:45.946256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:45.946256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:45.946365 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:45.946429 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:45.946675 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 17:52:45.946752 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:52:45.946993 19693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.938171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:50029)
0808 17:52:45.938460 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:45.938499 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:45.939067 (+ 568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:45.939322 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:45.939326 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:45.939985 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:45.940160 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:45.940165 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.941081 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.941082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:45.942127 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:45.942130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.942463 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.942465 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:45.942602 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:45.943016 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:45.943025 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:45.944335 (+ 1310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:45.945685 (+ 1350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:45.945691 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:45.945693 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:45.945915 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:45.946066 (+ 151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:45.946067 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:45.946067 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:45.946188 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:45.946430 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:45.946436 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:45.946560 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 17:52:45.946645 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 17:52:45.946785 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":85,"threads_started":1}
I20260808 17:52:45.947477 19691 heartbeater.cc:347] Connected to a master server at 127.28.213.190:44721
I20260808 17:52:45.947562 19691 heartbeater.cc:464] Registering TS with master...
I20260808 17:52:45.947719 19691 heartbeater.cc:511] Master 127.28.213.190:44721 requested a full tablet report, sending...
I20260808 17:52:45.948063 19695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.941716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47308 (local address 127.28.213.190:44721)
0808 17:52:45.942225 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:45.942227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:45.942232 (+ 5us) server_negotiation.cc:407] Connection header received
0808 17:52:45.942250 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:45.942251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:45.942261 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:45.942311 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:45.943005 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.943454 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.944201 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.944388 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.944453 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:45.945686 (+ 1233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:45.945687 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:45.945688 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:45.945694 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:45.946958 (+ 1264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:45.947300 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:45.947300 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:45.947301 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:45.947359 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:45.947541 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:45.947542 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:45.947542 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:45.947664 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:45.947823 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:45.947896 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 17:52:45.947975 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":51,"threads_started":1}
I20260808 17:52:45.948069 19013 ts_manager.cc:194] Registered new tserver with Master: 991a5aecdaf748ddaac3e7e93edda515 (127.28.213.131:45027)
I20260808 17:52:45.948524 19013 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:50029
I20260808 17:52:45.948727 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:52:45.951006 19695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.949020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47320 (local address 127.28.213.190:44721)
0808 17:52:45.949057 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:45.949059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:45.949169 (+ 110us) server_negotiation.cc:407] Connection header received
0808 17:52:45.949274 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:45.949275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:45.949309 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:45.949363 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:52:45.949441 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.949850 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.950482 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.950650 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.950689 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:45.950787 (+ 98us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:52:45.950865 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:52:45.950923 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:45.950934 (+ 11us) server_negotiation.cc:299] Negotiation successful
0808 17:52:45.950949 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:52:45.951244 19013 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:47320:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:52:45.952694 19013 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:52:45.954622 19188 tablet_service.cc:1467] Processing CreateTablet for tablet e217a7fda913472b8fa256a6aaab23cd (DEFAULT_TABLE table=test-table [id=b648466978564c61a1920af7c7fab606]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:52:45.954811 19188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e217a7fda913472b8fa256a6aaab23cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:52:45.956027 19130 tablet_bootstrap.cc:492] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1: Bootstrap starting.
I20260808 17:52:45.956324 19130 tablet_bootstrap.cc:654] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1: Neither blocks nor log segments found. Creating new log.
I20260808 17:52:45.958076 19130 tablet_bootstrap.cc:492] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1: No bootstrap required, opened a new log
I20260808 17:52:45.958122 19130 ts_tablet_manager.cc:1397] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260808 17:52:45.958256 19130 raft_consensus.cc:348] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } }
I20260808 17:52:45.958313 19130 raft_consensus.cc:374] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:52:45.958365 19130 raft_consensus.cc:729] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 635c62adb2ed40d0b9817fbb589789f1, State: Initialized, Role: FOLLOWER
I20260808 17:52:45.958408 19130 consensus_queue.cc:260] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } }
I20260808 17:52:45.958501 19130 ts_tablet_manager.cc:1428] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:45.959743 19308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.954331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:45027 (local address 127.0.0.1:38532)
0808 17:52:45.954373 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:45.954389 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:45.954426 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:45.956584 (+ 2158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:45.956585 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:45.956587 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:52:45.956629 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:45.956630 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.957783 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.957783 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:45.958823 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:45.958826 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.959464 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.959485 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:45.959558 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:45.959578 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 17:52:45.959630 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 17:52:45.959678 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 17:52:45.959769 19699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.954389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38532 (local address 127.28.213.131:45027)
0808 17:52:45.956433 (+ 2044us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:45.956437 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:45.956446 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:52:45.956476 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:45.956477 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:45.956492 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:45.956563 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:52:45.956704 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.957706 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.958904 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.959385 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.959451 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:45.959503 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:45.959655 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 17:52:45.959697 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2012,"thread_start_us":92,"threads_started":1}
I20260808 17:52:45.960005 19698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.954375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:42327 (local address 127.0.0.1:35902)
0808 17:52:45.956069 (+ 1694us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:45.956079 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:45.956130 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:45.956318 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:45.956319 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:45.956321 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:52:45.956366 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:45.956368 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.957666 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.957667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:45.958786 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:45.958789 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.959824 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.959825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:45.959875 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:45.959879 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:52:45.959927 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 17:52:45.959965 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1677,"thread_start_us":101,"threads_started":1}
I20260808 17:52:45.960216 19700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:45.954599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35902 (local address 127.28.213.130:42327)
0808 17:52:45.954771 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:45.954775 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:45.956182 (+ 1407us) server_negotiation.cc:407] Connection header received
0808 17:52:45.956223 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:45.956225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:45.956237 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:45.956301 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:52:45.956445 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.957582 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.958866 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:45.959389 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:45.959449 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:45.959483 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:45.960097 (+ 614us) server_negotiation.cc:299] Negotiation successful
0808 17:52:45.960139 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":93,"threads_started":1}
I20260808 17:52:45.960395 19593 tablet_service.cc:1467] Processing CreateTablet for tablet e217a7fda913472b8fa256a6aaab23cd (DEFAULT_TABLE table=test-table [id=b648466978564c61a1920af7c7fab606]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:52:45.960693 19593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e217a7fda913472b8fa256a6aaab23cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:52:45.961767 19399 tablet_service.cc:1467] Processing CreateTablet for tablet e217a7fda913472b8fa256a6aaab23cd (DEFAULT_TABLE table=test-table [id=b648466978564c61a1920af7c7fab606]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:52:45.962040 19399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e217a7fda913472b8fa256a6aaab23cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:52:45.963333 19702 tablet_bootstrap.cc:492] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515: Bootstrap starting.
I20260808 17:52:45.963872 19702 tablet_bootstrap.cc:654] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515: Neither blocks nor log segments found. Creating new log.
I20260808 17:52:45.964309 19702 log.cc:824] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515: Log is configured to *not* fsync() on all Append() calls
I20260808 17:52:45.964601 19703 tablet_bootstrap.cc:492] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072: Bootstrap starting.
I20260808 17:52:45.965113 19703 tablet_bootstrap.cc:654] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072: Neither blocks nor log segments found. Creating new log.
I20260808 17:52:45.965593 19703 log.cc:824] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072: Log is configured to *not* fsync() on all Append() calls
I20260808 17:52:45.965817 19702 tablet_bootstrap.cc:492] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515: No bootstrap required, opened a new log
I20260808 17:52:45.965957 19702 ts_tablet_manager.cc:1397] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 17:52:45.966317 19703 tablet_bootstrap.cc:492] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072: No bootstrap required, opened a new log
I20260808 17:52:45.966378 19703 ts_tablet_manager.cc:1397] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 17:52:45.967311 19702 raft_consensus.cc:348] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } }
I20260808 17:52:45.967440 19702 raft_consensus.cc:374] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:52:45.967461 19702 raft_consensus.cc:729] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 991a5aecdaf748ddaac3e7e93edda515, State: Initialized, Role: FOLLOWER
I20260808 17:52:45.967558 19702 consensus_queue.cc:260] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } }
I20260808 17:52:45.967691 19703 raft_consensus.cc:348] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } }
I20260808 17:52:45.967809 19702 ts_tablet_manager.cc:1428] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:52:45.967828 19691 heartbeater.cc:503] Master 127.28.213.190:44721 was elected leader, sending a full tablet report...
I20260808 17:52:45.967829 19703 raft_consensus.cc:374] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:52:45.967868 19703 raft_consensus.cc:729] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f66412d7334be280ee0e148d981072, State: Initialized, Role: FOLLOWER
I20260808 17:52:45.967969 19703 consensus_queue.cc:260] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } }
I20260808 17:52:45.968199 19703 ts_tablet_manager.cc:1428] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 17:52:45.968312 19492 heartbeater.cc:503] Master 127.28.213.190:44721 was elected leader, sending a full tablet report...
W20260808 17:52:46.058208 19493 tablet.cc:2369] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:52:46.128230 19707 raft_consensus.cc:482] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:52:46.128346 19707 raft_consensus.cc:504] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } }
I20260808 17:52:46.128726 19707 leader_election.cc:288] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13f66412d7334be280ee0e148d981072 (127.28.213.130:42327), 635c62adb2ed40d0b9817fbb589789f1 (127.28.213.129:40761)
I20260808 17:52:46.131664 19700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:46.128956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:43441 (local address 127.28.213.130:42327)
0808 17:52:46.129005 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:46.129007 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:46.129201 (+ 194us) server_negotiation.cc:407] Connection header received
0808 17:52:46.129254 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:46.129255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:46.129268 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:46.129324 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:52:46.129476 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:46.129959 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:46.130950 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:46.131332 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:46.131388 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:46.131396 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:46.131559 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 17:52:46.131598 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:52:46.131676 19693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:46.128892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:40761 (local address 127.28.213.131:50603)
0808 17:52:46.128956 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:46.128967 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:46.129011 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:46.129197 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:46.129197 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:46.129199 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:52:46.129296 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:46.129299 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:46.129981 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:46.129982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:46.130811 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:46.130814 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:46.131444 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:46.131445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:46.131503 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:46.131506 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:52:46.131554 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 17:52:46.131589 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":44}
I20260808 17:52:46.131677 19310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:46.128971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:50603 (local address 127.28.213.129:40761)
0808 17:52:46.129010 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:46.129012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:46.129020 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:52:46.129073 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:46.129074 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:46.129103 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:46.129185 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:52:46.129367 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:46.129905 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:46.130946 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:46.131351 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:46.131418 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:46.131493 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:46.131577 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 17:52:46.131616 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:52:46.131685 19710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:46.128893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:42327 (local address 127.28.213.131:43441)
0808 17:52:46.129124 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:46.129134 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:46.129193 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:46.129331 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:46.129332 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:46.129333 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:52:46.129415 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:46.129417 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:46.130034 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:46.130035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:46.130821 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:46.130823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:46.131416 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:46.131417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:46.131487 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:46.131495 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 17:52:46.131547 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 17:52:46.131588 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"mutex_wait_us":66,"thread_start_us":92,"threads_started":1}
I20260808 17:52:46.131973 19214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e217a7fda913472b8fa256a6aaab23cd" candidate_uuid: "991a5aecdaf748ddaac3e7e93edda515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "635c62adb2ed40d0b9817fbb589789f1" is_pre_election: true
I20260808 17:52:46.132128 19214 raft_consensus.cc:2454] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 991a5aecdaf748ddaac3e7e93edda515 in term 0.
I20260808 17:52:46.132169 19428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e217a7fda913472b8fa256a6aaab23cd" candidate_uuid: "991a5aecdaf748ddaac3e7e93edda515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f66412d7334be280ee0e148d981072" is_pre_election: true
I20260808 17:52:46.132325 19428 raft_consensus.cc:2454] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 991a5aecdaf748ddaac3e7e93edda515 in term 0.
I20260808 17:52:46.132355 19526 leader_election.cc:302] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 635c62adb2ed40d0b9817fbb589789f1, 991a5aecdaf748ddaac3e7e93edda515; no voters:
I20260808 17:52:46.132500 19707 raft_consensus.cc:2781] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:52:46.132566 19707 raft_consensus.cc:482] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:52:46.132601 19707 raft_consensus.cc:3037] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:52:46.133293 19707 raft_consensus.cc:504] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } }
I20260808 17:52:46.133405 19707 leader_election.cc:288] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [CANDIDATE]: Term 1 election: Requested vote from peers 13f66412d7334be280ee0e148d981072 (127.28.213.130:42327), 635c62adb2ed40d0b9817fbb589789f1 (127.28.213.129:40761)
I20260808 17:52:46.133563 19428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e217a7fda913472b8fa256a6aaab23cd" candidate_uuid: "991a5aecdaf748ddaac3e7e93edda515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f66412d7334be280ee0e148d981072"
I20260808 17:52:46.133634 19428 raft_consensus.cc:3037] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:52:46.134339 19428 raft_consensus.cc:2454] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 991a5aecdaf748ddaac3e7e93edda515 in term 1.
I20260808 17:52:46.134442 19214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e217a7fda913472b8fa256a6aaab23cd" candidate_uuid: "991a5aecdaf748ddaac3e7e93edda515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "635c62adb2ed40d0b9817fbb589789f1"
I20260808 17:52:46.134519 19523 leader_election.cc:302] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f66412d7334be280ee0e148d981072, 991a5aecdaf748ddaac3e7e93edda515; no voters:
I20260808 17:52:46.134524 19214 raft_consensus.cc:3037] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:52:46.134606 19707 raft_consensus.cc:2781] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:52:46.134732 19707 raft_consensus.cc:686] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [term 1 LEADER]: Becoming Leader. State: Replica: 991a5aecdaf748ddaac3e7e93edda515, State: Running, Role: LEADER
I20260808 17:52:46.134821 19707 consensus_queue.cc:237] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } }
I20260808 17:52:46.135260 19214 raft_consensus.cc:2454] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 991a5aecdaf748ddaac3e7e93edda515 in term 1.
I20260808 17:52:46.135762 19013 catalog_manager.cc:5495] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 reported cstate change: term changed from 0 to 1, leader changed from <none> to 991a5aecdaf748ddaac3e7e93edda515 (127.28.213.131). New cstate: current_term: 1 leader_uuid: "991a5aecdaf748ddaac3e7e93edda515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } health_report { overall_health: UNKNOWN } } }
W20260808 17:52:46.175870 19295 tablet.cc:2369] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:52:46.181605 19699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:46.179487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38536 (local address 127.28.213.131:45027)
0808 17:52:46.179541 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:46.179543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:46.179551 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:52:46.179584 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:46.179585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:46.179612 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:46.179677 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:52:46.179780 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:46.180231 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:46.180931 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:46.181118 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:46.181170 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:46.181303 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:52:46.181414 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:52:46.181473 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:46.181502 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 17:52:46.181519 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 17:52:46.183235 19214 raft_consensus.cc:1261] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Refusing update from remote peer 991a5aecdaf748ddaac3e7e93edda515: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:52:46.183238 19428 raft_consensus.cc:1261] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072 [term 1 FOLLOWER]: Refusing update from remote peer 991a5aecdaf748ddaac3e7e93edda515: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:52:46.183530 19707 consensus_queue.cc:1035] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:52:46.183663 19711 consensus_queue.cc:1035] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:52:46.185920 19716 mvcc.cc:205] Tried to move back new op lower bound from 7316322575084216320 to 7316322574888906752. Current Snapshot: MvccSnapshot[applied={T|T < 7316322575084216320}]
I20260808 17:52:46.188097 19012 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:47320:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:52:46.188175 19012 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:47320:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:52:46.188843 19012 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92: Sending DeleteTablet for 3 replicas of tablet e217a7fda913472b8fa256a6aaab23cd
I20260808 17:52:46.189126 19593 tablet_service.cc:1514] Processing DeleteTablet for tablet e217a7fda913472b8fa256a6aaab23cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:52:46 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:38532
I20260808 17:52:46.189200 19188 tablet_service.cc:1514] Processing DeleteTablet for tablet e217a7fda913472b8fa256a6aaab23cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:52:46 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:42962
I20260808 17:52:46.189239 19399 tablet_service.cc:1514] Processing DeleteTablet for tablet e217a7fda913472b8fa256a6aaab23cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:52:46 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:35902
I20260808 17:52:46.189323 19312 tablet_replica.cc:330] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1: stopping tablet replica
I20260808 17:52:46.189376 19312 raft_consensus.cc:2229] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:52:46.189427 19312 raft_consensus.cc:2258] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:52:46.189455 19735 tablet_replica.cc:330] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072: stopping tablet replica
I20260808 17:52:46.189476 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 19063
I20260808 17:52:46.189543 19735 raft_consensus.cc:2229] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:52:46.189632 19735 raft_consensus.cc:2258] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:52:46.194619 19735 ts_tablet_manager.cc:1905] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:52:46.196120 19735 ts_tablet_manager.cc:1918] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:52:46.196175 19735 log.cc:1196] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/e217a7fda913472b8fa256a6aaab23cd
I20260808 17:52:46.196642 19735 ts_tablet_manager.cc:1939] T e217a7fda913472b8fa256a6aaab23cd P 13f66412d7334be280ee0e148d981072: Deleting consensus metadata
I20260808 17:52:46.197343 19734 tablet_replica.cc:330] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515: stopping tablet replica
I20260808 17:52:46.197479 19734 raft_consensus.cc:2229] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:52:46.197600 19734 raft_consensus.cc:2258] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:52:46.198278 19734 ts_tablet_manager.cc:1905] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:52:46.199805 19734 ts_tablet_manager.cc:1918] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:52:46.199916 19734 log.cc:1196] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/e217a7fda913472b8fa256a6aaab23cd
I20260808 17:52:46.200208 19734 ts_tablet_manager.cc:1939] T e217a7fda913472b8fa256a6aaab23cd P 991a5aecdaf748ddaac3e7e93edda515: Deleting consensus metadata
I20260808 17:52:46.200666 18998 catalog_manager.cc:4841] TS 991a5aecdaf748ddaac3e7e93edda515 (127.28.213.131:45027): tablet e217a7fda913472b8fa256a6aaab23cd (table test-table [id=b648466978564c61a1920af7c7fab606]) successfully deleted
I20260808 17:52:46.202927 18996 catalog_manager.cc:4841] TS 13f66412d7334be280ee0e148d981072 (127.28.213.130:42327): tablet e217a7fda913472b8fa256a6aaab23cd (table test-table [id=b648466978564c61a1920af7c7fab606]) successfully deleted
W20260808 17:52:46.206671 18999 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.213.129:40761 (error 108)
I20260808 17:52:46.207077 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 19306
I20260808 17:52:46.207109 19698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:46.206985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:40761 (local address 127.0.0.1:42968)
0808 17:52:46.207036 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:46.207075 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.129:40761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 17:52:46.229130 18999 catalog_manager.cc:4584] TS 635c62adb2ed40d0b9817fbb589789f1 (127.28.213.129:40761): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e217a7fda913472b8fa256a6aaab23cd: Network error: Client connection negotiation failed: client connection to 127.28.213.129:40761: connect: Connection refused (error 111)
I20260808 17:52:46.234539 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 19496
I20260808 17:52:46.244179 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 18967
I20260808 17:52:46.253191 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:44721
--webserver_interface=127.28.213.190
--webserver_port=37621
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:44721
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:52:46.333024 19738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:46.333204 19738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:46.333248 19738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:46.334339 19738 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:52:46.334376 19738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:46.334389 19738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:46.334406 19738 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:52:46.334417 19738 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:52:46.335799 19738 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:44721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:44721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=37621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:46.335984 19738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:46.336146 19738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 17:52:46.340667 19738 server_base.cc:1034] running on GCE node
W20260808 17:52:46.340638 19746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:46.340620 19747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:46.340638 19751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:46.341145 19738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:46.341429 19738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:46.342564 19738 hybrid_clock.cc:648] HybridClock initialized: now 1786211566342553 us; error 29 us; skew 500 ppm
Aug 08 17:52:46 dist-test-slave-bndk krb5kdc[18101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211566, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:46.344861 19738 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:52:46.345304 19738 webserver.cc:460] Webserver started at http://127.28.213.190:37621/ using document root <none> and password file <none>
I20260808 17:52:46.345490 19738 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:46.345530 19738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:46.346678 19738 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:52:46.347256 19759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:46.347419 19738 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:52:46.347491 19738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "59ebcde977bb4cc0bb44103201cdac92"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "937ff6a04f7377ce69b7ac51b9a30658"
server_key_iv: "e4cd0a5505afd89e0a984391df89dc0a"
server_key_version: "encryptionkey@0"
I20260808 17:52:46.347815 19738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:46.364933 19738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:46.366991 19738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:46.367129 19738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:46.371040 19738 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:44721
I20260808 17:52:46.371073 19849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:44721 every 8 connection(s)
I20260808 17:52:46.371426 19738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:52:46.372874 19850 sys_catalog.cc:263] Verifying existing consensus state
I20260808 17:52:46.373514 19850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92: Bootstrap starting.
I20260808 17:52:46.377981 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 19738
I20260808 17:52:46.378244 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:40761
--local_ip_for_outbound_sockets=127.28.213.129
--tserver_master_addrs=127.28.213.190:44721
--webserver_port=33449
--webserver_interface=127.28.213.129
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:52:46.381619 19850 log.cc:824] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92: Log is configured to *not* fsync() on all Append() calls
I20260808 17:52:46.383617 19850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:52:46.383868 19850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92: Bootstrap complete.
I20260808 17:52:46.385900 19850 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ebcde977bb4cc0bb44103201cdac92" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44721 } }
I20260808 17:52:46.386111 19850 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59ebcde977bb4cc0bb44103201cdac92, State: Initialized, Role: FOLLOWER
I20260808 17:52:46.386261 19850 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ebcde977bb4cc0bb44103201cdac92" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44721 } }
I20260808 17:52:46.386333 19850 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:52:46.386382 19850 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:52:46.386425 19850 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 2 FOLLOWER]: Advancing to term 3
I20260808 17:52:46.387357 19850 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ebcde977bb4cc0bb44103201cdac92" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44721 } }
I20260808 17:52:46.387452 19850 leader_election.cc:302] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59ebcde977bb4cc0bb44103201cdac92; no voters:
I20260808 17:52:46.387606 19850 leader_election.cc:288] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 17:52:46.387655 19855 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 17:52:46.387799 19855 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [term 3 LEADER]: Becoming Leader. State: Replica: 59ebcde977bb4cc0bb44103201cdac92, State: Running, Role: LEADER
I20260808 17:52:46.387873 19850 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:52:46.387919 19855 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ebcde977bb4cc0bb44103201cdac92" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44721 } }
I20260808 17:52:46.388164 19855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59ebcde977bb4cc0bb44103201cdac92. Latest consensus state: current_term: 3 leader_uuid: "59ebcde977bb4cc0bb44103201cdac92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ebcde977bb4cc0bb44103201cdac92" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44721 } } }
I20260808 17:52:46.388411 19855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [sys.catalog]: This master's current role is: LEADER
I20260808 17:52:46.388342 19857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "59ebcde977bb4cc0bb44103201cdac92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ebcde977bb4cc0bb44103201cdac92" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44721 } } }
I20260808 17:52:46.388805 19857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59ebcde977bb4cc0bb44103201cdac92 [sys.catalog]: This master's current role is: LEADER
I20260808 17:52:46.388787 19869 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:52:46.389631 19869 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:52:46.389731 19869 catalog_manager.cc:1259] Loaded cluster ID: 0e01015f3f624576bd8757806ba99fff
I20260808 17:52:46.389809 19869 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 17:52:46.390187 19869 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7faa3349f9ad google::LogMessage::Fail() at ??:0
@ 0x7faa334a288a google::LogMessage::SendToLog() at ??:0
@ 0x7faa3349f4de google::LogMessage::Flush() at ??:0
@ 0x7faa334a0a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7faa3b3c40f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7faa3b3cd8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7faa3536d0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7faa35362954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7faa361c66db start_thread at ??:0
@ 0x7faa31f9d61f clone at ??:0
W20260808 17:52:46.470734 19853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:46.470989 19853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:46.471028 19853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:46.472635 19853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:46.472689 19853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:46.472728 19853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:52:46.474838 19853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:40761
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=33449
--tserver_master_addrs=127.28.213.190:44721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:46.475099 19853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:46.475345 19853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:46.480078 19902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:46.480118 19899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:46.480345 19900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:46.480388 19853 server_base.cc:1034] running on GCE node
I20260808 17:52:46.480602 19853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:46.480880 19853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:46.482056 19853 hybrid_clock.cc:648] HybridClock initialized: now 1786211566482041 us; error 27 us; skew 500 ppm
Aug 08 17:52:46 dist-test-slave-bndk krb5kdc[18101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211566, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:46.485080 19853 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:52:46.485625 19853 webserver.cc:460] Webserver started at http://127.28.213.129:33449/ using document root <none> and password file <none>
I20260808 17:52:46.485906 19853 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:46.485976 19853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:46.487640 19853 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:52:46.488351 19913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:46.488516 19853 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:52:46.488598 19853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "635c62adb2ed40d0b9817fbb589789f1"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "50283a05bb06f91accf7ce1c2b5f12cf"
server_key_iv: "397143afbcb581ff8f6e203b83f86e46"
server_key_version: "encryptionkey@0"
I20260808 17:52:46.488922 19853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:46.500396 19853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:46.502355 19853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:46.502466 19853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:46.502661 19853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:52:46.503075 19927 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 17:52:46.504967 19853 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 17:52:46.505008 19853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 17:52:46.505038 19853 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 17:52:46.505674 19853 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 17:52:46.505707 19853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 17:52:46.505793 19927 tablet_bootstrap.cc:492] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1: Bootstrap starting.
I20260808 17:52:46.512110 19853 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:40761
I20260808 17:52:46.512241 20078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:40761 every 8 connection(s)
I20260808 17:52:46.512495 19853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:52:46.513578 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 19853
I20260808 17:52:46.513816 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:42327
--local_ip_for_outbound_sockets=127.28.213.130
--tserver_master_addrs=127.28.213.190:44721
--webserver_port=40219
--webserver_interface=127.28.213.130
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:52:46.517043 19927 log.cc:824] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1: Log is configured to *not* fsync() on all Append() calls
I20260808 17:52:46.519672 19927 tablet_bootstrap.cc:492] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:52:46.519974 19927 tablet_bootstrap.cc:492] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1: Bootstrap complete.
I20260808 17:52:46.521062 19927 ts_tablet_manager.cc:1397] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.011s
I20260808 17:52:46.522451 19927 raft_consensus.cc:348] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } }
I20260808 17:52:46.522781 19927 raft_consensus.cc:729] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 635c62adb2ed40d0b9817fbb589789f1, State: Initialized, Role: FOLLOWER
I20260808 17:52:46.522927 19927 consensus_queue.cc:260] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } }
I20260808 17:52:46.523197 19927 ts_tablet_manager.cc:1428] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1: Time spent starting tablet: real 0.002s user 0.004s sys 0.001s
W20260808 17:52:46.584905 20081 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:52:46.513102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:58049)
0808 17:52:46.513295 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:46.513348 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:46.515852 (+ 2504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:46.584708 (+ 68856us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":130,"threads_started":1}
W20260808 17:52:46.585153 20079 heartbeater.cc:644] Failed to heartbeat to 127.28.213.190:44721 (0 consecutive failures): Network error: Failed to ping master at 127.28.213.190:44721: Client connection negotiation failed: client connection to 127.28.213.190:44721: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 17:52:46.585517 20081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:46.585407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:45697)
0808 17:52:46.585454 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:46.585494 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 17:52:46.585860 20081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:46.585783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:52519)
0808 17:52:46.585822 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:46.585845 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 17:52:46.585992 20079 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 17:52:46.596181 20082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:46.596359 20082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:46.596381 20082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:46.597527 20082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:46.597573 20082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:46.597599 20082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:52:46.599032 20082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:42327
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=40219
--tserver_master_addrs=127.28.213.190:44721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:46.599201 20082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:46.599375 20082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:52:46.603860 20090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:46.603880 20089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:46.603880 20092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:46.603997 20082 server_base.cc:1034] running on GCE node
I20260808 17:52:46.604163 20082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:46.604380 20082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:46.605510 20082 hybrid_clock.cc:648] HybridClock initialized: now 1786211566605494 us; error 27 us; skew 500 ppm
Aug 08 17:52:46 dist-test-slave-bndk krb5kdc[18101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211566, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:46.607738 20082 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:52:46.608126 20082 webserver.cc:460] Webserver started at http://127.28.213.130:40219/ using document root <none> and password file <none>
I20260808 17:52:46.608309 20082 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:46.608356 20082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:46.609572 20082 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:52:46.610095 20103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:46.610234 20082 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:52:46.610311 20082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "13f66412d7334be280ee0e148d981072"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "ebc9752eaa1780cdca724b20ce9b1f62"
server_key_iv: "d93186a171cf4a1e1e65e60197c3eb02"
server_key_version: "encryptionkey@0"
I20260808 17:52:46.610598 20082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:46.641753 20082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:46.643666 20082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:46.643793 20082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:46.644011 20082 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:52:46.644274 20082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:52:46.644306 20082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:46.644333 20082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:52:46.644351 20082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:46.649878 20082 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:42327
I20260808 17:52:46.649945 20272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:42327 every 8 connection(s)
I20260808 17:52:46.650221 20082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:52:46.651117 20276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:46.650768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:47001)
0808 17:52:46.650919 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:46.650988 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":79,"threads_started":1}
W20260808 17:52:46.651499 20274 heartbeater.cc:644] Failed to heartbeat to 127.28.213.190:44721 (0 consecutive failures): Network error: Failed to ping master at 127.28.213.190:44721: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
I20260808 17:52:46.651589 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 20082
I20260808 17:52:46.651785 20276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:46.651710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:54567)
0808 17:52:46.651742 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:46.651767 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260808 17:52:46.651870 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:45027
--local_ip_for_outbound_sockets=127.28.213.131
--tserver_master_addrs=127.28.213.190:44721
--webserver_port=36251
--webserver_interface=127.28.213.131
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:52:46.652066 20276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:46.651978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:39139)
0808 17:52:46.652019 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:46.652041 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 17:52:46.652191 20274 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 17:52:46.732089 20279 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:52:46.732268 20279 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:52:46.732290 20279 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:52:46.733417 20279 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:52:46.733455 20279 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:52:46.733486 20279 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:52:46.734897 20279 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:45027
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=36251
--tserver_master_addrs=127.28.213.190:44721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20279
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:52:46.735101 20279 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:52:46.735301 20279 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 17:52:46.739928 20279 server_base.cc:1034] running on GCE node
W20260808 17:52:46.739892 20284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:46.739907 20285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:52:46.739899 20288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:52:46.740257 20279 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:52:46.740484 20279 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:52:46.741605 20279 hybrid_clock.cc:648] HybridClock initialized: now 1786211566741596 us; error 26 us; skew 500 ppm
Aug 08 17:52:46 dist-test-slave-bndk krb5kdc[18101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211566, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:52:46.743855 20279 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:52:46.744232 20279 webserver.cc:460] Webserver started at http://127.28.213.131:36251/ using document root <none> and password file <none>
I20260808 17:52:46.744437 20279 fs_manager.cc:359] Metadata directory not provided
I20260808 17:52:46.744481 20279 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:52:46.745725 20279 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:52:46.746269 20298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:46.746481 20279 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:52:46.746558 20279 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "991a5aecdaf748ddaac3e7e93edda515"
format_stamp: "Formatted at 2026-08-08 17:52:44 on dist-test-slave-bndk"
server_key: "fe3b7702c46dae01e486bdd80d71106d"
server_key_iv: "e49144ca9adb38ff4ae375833e30c06a"
server_key_version: "encryptionkey@0"
I20260808 17:52:46.746901 20279 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:52:46.769208 20279 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:52:46.771240 20279 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:52:46.771359 20279 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:52:46.771538 20279 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:52:46.771773 20279 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:52:46.771811 20279 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:46.771842 20279 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:52:46.771863 20279 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:52:46.777618 20279 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:45027
I20260808 17:52:46.777689 20465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:45027 every 8 connection(s)
I20260808 17:52:46.777989 20279 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:52:46.778909 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:46.778571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:45835)
0808 17:52:46.778711 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:46.778781 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":72,"threads_started":1}
W20260808 17:52:46.779256 20466 heartbeater.cc:644] Failed to heartbeat to 127.28.213.190:44721 (0 consecutive failures): Network error: Failed to ping master at 127.28.213.190:44721: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
I20260808 17:52:46.779477 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:46.779401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:49551)
0808 17:52:46.779438 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:46.779462 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 17:52:46.779680 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:46.779622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:48169)
0808 17:52:46.779652 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:46.779669 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260808 17:52:46.779762 20466 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 17:52:46.787276 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 20279
I20260808 17:52:47.586493 20471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:47.586275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:46671)
0808 17:52:47.586390 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:47.586426 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":60,"threads_started":1}
I20260808 17:52:47.652659 20474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:47.652467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:45197)
0808 17:52:47.652574 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:47.652607 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":56,"threads_started":1}
I20260808 17:52:47.780225 20475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:47.780043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:49241)
0808 17:52:47.780147 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:47.780177 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":56,"threads_started":1}
I20260808 17:52:47.985180 20476 raft_consensus.cc:482] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:52:47.985349 20476 raft_consensus.cc:504] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } }
I20260808 17:52:47.985710 20476 leader_election.cc:288] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 991a5aecdaf748ddaac3e7e93edda515 (127.28.213.131:45027), 13f66412d7334be280ee0e148d981072 (127.28.213.130:42327)
Aug 08 17:52:47 dist-test-slave-bndk krb5kdc[18101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211566, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.131@KRBTEST.COM
Aug 08 17:52:47 dist-test-slave-bndk krb5kdc[18101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211566, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.130@KRBTEST.COM
I20260808 17:52:47.995365 20471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:47.985828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:45027 (local address 127.28.213.129:48707)
0808 17:52:47.985868 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:47.985879 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:47.985939 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:47.986759 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:47.986762 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:47.987127 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:47.987305 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:47.987311 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:47.988336 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:47.988338 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:47.989180 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:47.989183 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:47.989743 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:47.989744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:47.989849 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:47.990390 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:47.990399 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:47.991976 (+ 1577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:47.993860 (+ 1884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:47.993867 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:47.993869 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:47.994150 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:47.994399 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:47.994400 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:47.994400 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:47.994523 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:47.994867 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:47.994874 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:47.994998 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 17:52:47.995086 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 17:52:47.995264 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21,"mutex_wait_us":68}
I20260808 17:52:47.995378 20478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:47.985937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:48707 (local address 127.28.213.131:45027)
0808 17:52:47.986058 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:47.986069 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:47.986098 (+ 29us) server_negotiation.cc:407] Connection header received
0808 17:52:47.986540 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:47.986542 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:47.986581 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:47.986705 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:47.987413 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:47.988243 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:47.989292 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:47.989673 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:47.989764 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:47.992131 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:47.992136 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:47.992136 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:47.992148 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:47.993754 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:47.994224 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:47.994227 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:47.994228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:47.994338 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:47.994583 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:47.994584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:47.994584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:47.994802 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:47.994873 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:47.995151 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 17:52:47.995269 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81,"thread_start_us":47,"threads_started":1}
I20260808 17:52:47.995383 20479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:47.986004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:50393 (local address 127.28.213.130:42327)
0808 17:52:47.986167 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 17:52:47.986178 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 17:52:47.986214 (+ 36us) server_negotiation.cc:407] Connection header received
0808 17:52:47.986630 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:52:47.986632 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:52:47.986667 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:52:47.986781 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:52:47.987413 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:47.988264 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:47.989278 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:52:47.989658 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:52:47.989758 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:47.992389 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:52:47.992393 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:52:47.992393 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:52:47.992402 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:52:47.993967 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:47.994302 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:47.994305 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:47.994305 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:47.994394 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:52:47.994580 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:52:47.994581 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:52:47.994581 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:52:47.994801 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:52:47.994873 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 17:52:47.995148 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 17:52:47.995261 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":68,"threads_started":1}
I20260808 17:52:47.995453 20477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:47.985856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:42327 (local address 127.28.213.129:50393)
0808 17:52:47.986073 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:47.986084 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:52:47.986142 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:52:47.986780 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:52:47.986781 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:52:47.987128 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:52:47.987305 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:47.987311 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:47.988358 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:47.988359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:47.989180 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:52:47.989182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:52:47.989740 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:52:47.989741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:52:47.989847 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:52:47.990429 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:52:47.990434 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:52:47.992301 (+ 1867us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:52:47.994052 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:47.994053 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:47.994053 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:47.994225 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:47.994463 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:52:47.994464 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:52:47.994464 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:52:47.994524 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:52:47.994869 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:52:47.994876 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:52:47.994998 (+ 122us) client_negotiation.cc:769] Sending connection context
0808 17:52:47.995086 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 17:52:47.995336 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":161,"thread_start_us":61,"threads_started":1}
W20260808 17:52:47.996645 19914 leader_election.cc:341] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 13f66412d7334be280ee0e148d981072 (127.28.213.130:42327): Not found: Tablet not found: e217a7fda913472b8fa256a6aaab23cd
W20260808 17:52:47.996734 19919 leader_election.cc:341] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 991a5aecdaf748ddaac3e7e93edda515 (127.28.213.131:45027): Not found: Tablet not found: e217a7fda913472b8fa256a6aaab23cd
I20260808 17:52:47.996783 19919 leader_election.cc:302] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 635c62adb2ed40d0b9817fbb589789f1; no voters: 13f66412d7334be280ee0e148d981072, 991a5aecdaf748ddaac3e7e93edda515
I20260808 17:52:47.996878 20476 raft_consensus.cc:2726] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:52:48.587075 20481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:48.586870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:45031)
0808 17:52:48.586994 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:48.587028 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":61,"threads_started":1}
I20260808 17:52:48.653187 20484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:48.653020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:44977)
0808 17:52:48.653120 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:48.653151 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":54,"threads_started":1}
I20260808 17:52:48.780772 20485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:48.780595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:42821)
0808 17:52:48.780703 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:48.780735 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":60,"threads_started":1}
I20260808 17:52:49.587705 20486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:49.587498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:49909)
0808 17:52:49.587627 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:49.587658 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":66,"threads_started":1}
I20260808 17:52:49.653753 20487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:49.653579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:43299)
0808 17:52:49.653684 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:49.653716 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":60,"threads_started":1}
I20260808 17:52:49.781419 20488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:49.781187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:34179)
0808 17:52:49.781341 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:49.781376 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":108,"threads_started":1}
I20260808 17:52:50.148729 20489 raft_consensus.cc:482] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:52:50.148818 20489 raft_consensus.cc:504] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } }
I20260808 17:52:50.148959 20489 leader_election.cc:288] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 991a5aecdaf748ddaac3e7e93edda515 (127.28.213.131:45027), 13f66412d7334be280ee0e148d981072 (127.28.213.130:42327)
W20260808 17:52:50.149339 19919 leader_election.cc:341] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 991a5aecdaf748ddaac3e7e93edda515 (127.28.213.131:45027): Not found: Tablet not found: e217a7fda913472b8fa256a6aaab23cd
W20260808 17:52:50.149426 19914 leader_election.cc:341] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 13f66412d7334be280ee0e148d981072 (127.28.213.130:42327): Not found: Tablet not found: e217a7fda913472b8fa256a6aaab23cd
I20260808 17:52:50.149488 19914 leader_election.cc:302] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 635c62adb2ed40d0b9817fbb589789f1; no voters: 13f66412d7334be280ee0e148d981072, 991a5aecdaf748ddaac3e7e93edda515
I20260808 17:52:50.149556 20489 raft_consensus.cc:2726] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:52:50.588305 20490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:50.588099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:42957)
0808 17:52:50.588215 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:50.588250 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":62,"threads_started":1}
I20260808 17:52:50.654275 20492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:50.654094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:42409)
0808 17:52:50.654203 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:50.654237 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":54,"threads_started":1}
I20260808 17:52:50.781978 20493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:50.781793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:36319)
0808 17:52:50.781907 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:50.781941 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":57,"threads_started":1}
I20260808 17:52:51.588960 20494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:51.588756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:57721)
0808 17:52:51.588877 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:51.588913 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
I20260808 17:52:51.654865 20496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:51.654687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:33037)
0808 17:52:51.654793 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:51.654825 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":57,"threads_started":1}
I20260808 17:52:51.782511 20497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:51.782328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:59803)
0808 17:52:51.782437 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:51.782471 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":58,"threads_started":1}
I20260808 17:52:52.589617 20499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:52.589399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:56253)
0808 17:52:52.589534 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:52.589567 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":65,"threads_started":1}
I20260808 17:52:52.655458 20501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:52.655232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:45405)
0808 17:52:52.655378 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:52.655414 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":74,"threads_started":1}
I20260808 17:52:52.783048 20503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:52.782846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:34357)
0808 17:52:52.782973 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:52.783007 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":80,"threads_started":1}
I20260808 17:52:53.414796 20504 raft_consensus.cc:482] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:52:53.414894 20504 raft_consensus.cc:504] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } }
I20260808 17:52:53.415066 20504 leader_election.cc:288] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 991a5aecdaf748ddaac3e7e93edda515 (127.28.213.131:45027), 13f66412d7334be280ee0e148d981072 (127.28.213.130:42327)
W20260808 17:52:53.415402 19914 leader_election.cc:341] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 13f66412d7334be280ee0e148d981072 (127.28.213.130:42327): Not found: Tablet not found: e217a7fda913472b8fa256a6aaab23cd
W20260808 17:52:53.415490 19919 leader_election.cc:341] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 991a5aecdaf748ddaac3e7e93edda515 (127.28.213.131:45027): Not found: Tablet not found: e217a7fda913472b8fa256a6aaab23cd
I20260808 17:52:53.415536 19919 leader_election.cc:302] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 635c62adb2ed40d0b9817fbb589789f1; no voters: 13f66412d7334be280ee0e148d981072, 991a5aecdaf748ddaac3e7e93edda515
I20260808 17:52:53.415598 20504 raft_consensus.cc:2726] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:52:53.590222 20506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:53.590002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:57947)
0808 17:52:53.590141 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:53.590174 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":79,"threads_started":1}
I20260808 17:52:53.656006 20507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:53.655821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:44843)
0808 17:52:53.655937 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:53.655968 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":56,"threads_started":1}
I20260808 17:52:53.783591 20508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:53.783404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:54063)
0808 17:52:53.783516 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:53.783550 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":61,"threads_started":1}
I20260808 17:52:54.590811 20509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:54.590617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:49905)
0808 17:52:54.590731 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:54.590763 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":64,"threads_started":1}
I20260808 17:52:54.656580 20510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:54.656394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:52485)
0808 17:52:54.656504 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:54.656539 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":58,"threads_started":1}
I20260808 17:52:54.784178 20512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:54.783992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:48967)
0808 17:52:54.784104 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:54.784137 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":58,"threads_started":1}
I20260808 17:52:55.591367 20513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:55.591155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:46001)
0808 17:52:55.591284 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:55.591319 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":64,"threads_started":1}
I20260808 17:52:55.657122 20514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:55.656940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:57767)
0808 17:52:55.657057 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:55.657086 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":54,"threads_started":1}
I20260808 17:52:55.784726 20515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:55.784536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:46793)
0808 17:52:55.784659 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:55.784686 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":76,"threads_started":1}
I20260808 17:52:56.591941 20516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:56.591746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:55049)
0808 17:52:56.591855 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:56.591887 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":58,"threads_started":1}
I20260808 17:52:56.657717 20518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:56.657526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:33103)
0808 17:52:56.657647 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:56.657679 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":70,"threads_started":1}
I20260808 17:52:56.785347 20521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:56.785106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:36463)
0808 17:52:56.785274 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:56.785308 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":79,"threads_started":1}
I20260808 17:52:57.592494 20522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:57.592295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:54495)
0808 17:52:57.592409 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:57.592445 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":59,"threads_started":1}
I20260808 17:52:57.658282 20523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:57.658105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:59939)
0808 17:52:57.658209 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:57.658240 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":60,"threads_started":1}
I20260808 17:52:57.762542 20524 raft_consensus.cc:482] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:52:57.762634 20524 raft_consensus.cc:504] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } }
I20260808 17:52:57.762781 20524 leader_election.cc:288] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 991a5aecdaf748ddaac3e7e93edda515 (127.28.213.131:45027), 13f66412d7334be280ee0e148d981072 (127.28.213.130:42327)
W20260808 17:52:57.763147 19914 leader_election.cc:341] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 13f66412d7334be280ee0e148d981072 (127.28.213.130:42327): Not found: Tablet not found: e217a7fda913472b8fa256a6aaab23cd
W20260808 17:52:57.763247 19919 leader_election.cc:341] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 991a5aecdaf748ddaac3e7e93edda515 (127.28.213.131:45027): Not found: Tablet not found: e217a7fda913472b8fa256a6aaab23cd
I20260808 17:52:57.763300 19919 leader_election.cc:302] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 635c62adb2ed40d0b9817fbb589789f1; no voters: 13f66412d7334be280ee0e148d981072, 991a5aecdaf748ddaac3e7e93edda515
I20260808 17:52:57.763365 20524 raft_consensus.cc:2726] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:52:57.785957 20525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:57.785724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:44043)
0808 17:52:57.785862 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:57.785896 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":74,"threads_started":1}
I20260808 17:52:58.593083 20527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:58.592858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:36417)
0808 17:52:58.592996 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:58.593034 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":83,"threads_started":1}
I20260808 17:52:58.658828 20528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:58.658622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:40035)
0808 17:52:58.658731 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:58.658765 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":54,"threads_started":1}
I20260808 17:52:58.786513 20529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:58.786328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:54709)
0808 17:52:58.786437 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:58.786472 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":57,"threads_started":1}
I20260808 17:52:59.332121 20530 raft_consensus.cc:482] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:52:59.332226 20530 raft_consensus.cc:504] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "991a5aecdaf748ddaac3e7e93edda515" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45027 } } peers { permanent_uuid: "13f66412d7334be280ee0e148d981072" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 42327 } } peers { permanent_uuid: "635c62adb2ed40d0b9817fbb589789f1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40761 } }
I20260808 17:52:59.332391 20530 leader_election.cc:288] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 991a5aecdaf748ddaac3e7e93edda515 (127.28.213.131:45027), 13f66412d7334be280ee0e148d981072 (127.28.213.130:42327)
W20260808 17:52:59.332763 19914 leader_election.cc:341] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 13f66412d7334be280ee0e148d981072 (127.28.213.130:42327): Not found: Tablet not found: e217a7fda913472b8fa256a6aaab23cd
W20260808 17:52:59.332856 19919 leader_election.cc:341] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 991a5aecdaf748ddaac3e7e93edda515 (127.28.213.131:45027): Not found: Tablet not found: e217a7fda913472b8fa256a6aaab23cd
I20260808 17:52:59.332945 19919 leader_election.cc:302] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 635c62adb2ed40d0b9817fbb589789f1; no voters: 13f66412d7334be280ee0e148d981072, 991a5aecdaf748ddaac3e7e93edda515
I20260808 17:52:59.333024 20530 raft_consensus.cc:2726] T e217a7fda913472b8fa256a6aaab23cd P 635c62adb2ed40d0b9817fbb589789f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:52:59.593674 20532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:59.593476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:39593)
0808 17:52:59.593593 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:59.593628 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":67,"threads_started":1}
I20260808 17:52:59.659444 20533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:59.659227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:52731)
0808 17:52:59.659363 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:59.659395 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":75,"threads_started":1}
I20260808 17:52:59.787123 20534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:52:59.786918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:33989)
0808 17:52:59.787042 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 17:52:59.787079 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":58,"threads_started":1}
I20260808 17:53:00.594250 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:00.594043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:55851)
0808 17:53:00.594172 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:00.594203 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":61,"threads_started":1}
I20260808 17:53:00.660020 20537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:00.659822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:50209)
0808 17:53:00.659948 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:00.659980 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":84,"threads_started":1}
I20260808 17:53:00.787683 20538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:00.787498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:47411)
0808 17:53:00.787610 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:00.787642 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":65,"threads_started":1}
I20260808 17:53:01.594872 20540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:01.594686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.129:53917)
0808 17:53:01.594797 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:01.594827 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":60,"threads_started":1}
I20260808 17:53:01.660660 20541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:01.660476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.130:40967)
0808 17:53:01.660589 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:01.660621 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":59,"threads_started":1}
I20260808 17:53:01.788336 20542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:01.788142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44721 (local address 127.28.213.131:37113)
0808 17:53:01.788268 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:01.788297 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:44721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":74,"threads_started":1}
I20260808 17:53:01.796118 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 19853
I20260808 17:53:01.808013 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 20082
I20260808 17:53:01.816725 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 20279
2026-08-08T17:53:01Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18774 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:53:01 dist-test-slave-bndk krb5kdc[20545](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:53:01 dist-test-slave-bndk krb5kdc[20545](info): set up 2 sockets
Aug 08 17:53:01 dist-test-slave-bndk krb5kdc[20545](info): commencing operation
krb5kdc: starting...
W20260808 17:53:02.945911 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:53:03 dist-test-slave-bndk krb5kdc[20545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:53:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:53:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:53:03.057333 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:33445
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:33445
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:53:03.136157 20568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:53:03.136343 20568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:53:03.136373 20568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:53:03.137493 20568 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 17:53:03.137531 20568 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 17:53:03.137547 20568 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 17:53:03.137562 20568 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:53:03.137578 20568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:53:03.137595 20568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:53:03.137617 20568 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:53:03.137641 20568 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:53:03.139066 20568 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:33445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:33445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:53:03.139294 20568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:53:03.139501 20568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:53:03.143959 20582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:53:03.144021 20568 server_base.cc:1034] running on GCE node
W20260808 17:53:03.144026 20580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:53:03.143955 20584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:53:03.144330 20568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:53:03.144580 20568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:53:03.145715 20568 hybrid_clock.cc:648] HybridClock initialized: now 1786211583145701 us; error 31 us; skew 500 ppm
Aug 08 17:53:03 dist-test-slave-bndk krb5kdc[20545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211583, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:53:03.147949 20568 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:53:03.148330 20568 webserver.cc:460] Webserver started at http://127.28.213.190:43377/ using document root <none> and password file <none>
I20260808 17:53:03.148543 20568 fs_manager.cc:359] Metadata directory not provided
I20260808 17:53:03.148592 20568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:53:03.148712 20568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:53:03.149713 20568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "b86f6b7e29964e3db796fe7e7309acf2"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "42e8a256d731884bc8a5d1b1c9fb87fd"
server_key_iv: "b1585aa77e328071d239c6259db53990"
server_key_version: "encryptionkey@0"
I20260808 17:53:03.150034 20568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "b86f6b7e29964e3db796fe7e7309acf2"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "42e8a256d731884bc8a5d1b1c9fb87fd"
server_key_iv: "b1585aa77e328071d239c6259db53990"
server_key_version: "encryptionkey@0"
I20260808 17:53:03.151237 20568 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:53:03.151890 20596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:03.152041 20568 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:53:03.152122 20568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "b86f6b7e29964e3db796fe7e7309acf2"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "42e8a256d731884bc8a5d1b1c9fb87fd"
server_key_iv: "b1585aa77e328071d239c6259db53990"
server_key_version: "encryptionkey@0"
I20260808 17:53:03.152179 20568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:53:03.161294 20568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:53:03.162869 20568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:53:03.162997 20568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:53:03.166712 20568 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:33445
I20260808 17:53:03.166756 20672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:33445 every 8 connection(s)
I20260808 17:53:03.167049 20568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:53:03.167869 20673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:53:03.170054 20673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: Bootstrap starting.
I20260808 17:53:03.170640 20673 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: Neither blocks nor log segments found. Creating new log.
I20260808 17:53:03.170908 20673 log.cc:824] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: Log is configured to *not* fsync() on all Append() calls
I20260808 17:53:03.171233 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 20568
I20260808 17:53:03.171334 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:53:03.171554 29526 external_mini_cluster.cc:1428] Setting key 68c2887cfd1ba261e28ffb9be3d1add7
I20260808 17:53:03.171624 20673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: No bootstrap required, opened a new log
I20260808 17:53:03.173761 20673 raft_consensus.cc:348] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86f6b7e29964e3db796fe7e7309acf2" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33445 } }
I20260808 17:53:03.173905 20673 raft_consensus.cc:374] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:53:03.173938 20673 raft_consensus.cc:729] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b86f6b7e29964e3db796fe7e7309acf2, State: Initialized, Role: FOLLOWER
I20260808 17:53:03.174059 20673 consensus_queue.cc:260] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86f6b7e29964e3db796fe7e7309acf2" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33445 } }
I20260808 17:53:03.174129 20673 raft_consensus.cc:388] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:53:03.174158 20673 raft_consensus.cc:482] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:53:03.174203 20673 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:53:03.174707 20673 raft_consensus.cc:504] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86f6b7e29964e3db796fe7e7309acf2" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33445 } }
I20260808 17:53:03.174800 20673 leader_election.cc:302] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b86f6b7e29964e3db796fe7e7309acf2; no voters:
I20260808 17:53:03.174954 20673 leader_election.cc:288] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:53:03.174994 20681 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:53:03.175110 20681 raft_consensus.cc:686] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 1 LEADER]: Becoming Leader. State: Replica: b86f6b7e29964e3db796fe7e7309acf2, State: Running, Role: LEADER
I20260808 17:53:03.175205 20673 sys_catalog.cc:564] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:53:03.175249 20681 consensus_queue.cc:237] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86f6b7e29964e3db796fe7e7309acf2" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33445 } }
I20260808 17:53:03.175627 20681 sys_catalog.cc:455] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b86f6b7e29964e3db796fe7e7309acf2. Latest consensus state: current_term: 1 leader_uuid: "b86f6b7e29964e3db796fe7e7309acf2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86f6b7e29964e3db796fe7e7309acf2" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33445 } } }
I20260808 17:53:03.175670 20682 sys_catalog.cc:455] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b86f6b7e29964e3db796fe7e7309acf2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86f6b7e29964e3db796fe7e7309acf2" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33445 } } }
I20260808 17:53:03.175794 20681 sys_catalog.cc:458] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [sys.catalog]: This master's current role is: LEADER
I20260808 17:53:03.175803 20682 sys_catalog.cc:458] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [sys.catalog]: This master's current role is: LEADER
I20260808 17:53:03.176086 20694 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:53:03.176614 20694 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:53:03.178108 20694 catalog_manager.cc:1347] Generated new cluster ID: 847c4444efd34a4aaa9c7cf63ab87073
I20260808 17:53:03.178161 20694 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:53:03 dist-test-slave-bndk krb5kdc[20545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:53:03.181972 20680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.172025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59292 (local address 127.28.213.190:33445)
0808 17:53:03.172180 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:03.172187 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:03.172211 (+ 24us) server_negotiation.cc:407] Connection header received
0808 17:53:03.172845 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:03.172852 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:03.172899 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:03.173005 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:53:03.173788 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.175030 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.176067 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.176652 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.177107 (+ 455us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:03.179071 (+ 1964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:53:03.179075 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:53:03.179076 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:53:03.179085 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:53:03.180540 (+ 1455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:03.180862 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:03.180864 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:03.180864 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:03.180943 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:03.181123 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:03.181124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:03.181124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:03.181384 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:53:03.181527 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:03.181644 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 17:53:03.181770 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":62,"threads_started":1}
I20260808 17:53:03.196872 20694 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:53:03.197400 20694 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:53:03.204352 20694 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: Generated new TSK 0
I20260808 17:53:03.204511 20694 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
I20260808 17:53:03.229780 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:33445
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:53:03.308638 20708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:53:03.308823 20708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:53:03.308844 20708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:53:03.309969 20708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:53:03.310009 20708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:53:03.310035 20708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:53:03.311482 20708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:33445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:53:03.311699 20708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:53:03.311909 20708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:53:03.316445 20720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:53:03.316452 20717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:53:03.316466 20718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:53:03.316728 20708 server_base.cc:1034] running on GCE node
I20260808 17:53:03.316939 20708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:53:03.317167 20708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:53:03.318306 20708 hybrid_clock.cc:648] HybridClock initialized: now 1786211583318296 us; error 27 us; skew 500 ppm
Aug 08 17:53:03 dist-test-slave-bndk krb5kdc[20545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211583, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:53:03.320771 20708 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:53:03.321193 20708 webserver.cc:460] Webserver started at http://127.28.213.129:44231/ using document root <none> and password file <none>
I20260808 17:53:03.321462 20708 fs_manager.cc:359] Metadata directory not provided
I20260808 17:53:03.321511 20708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:53:03.321640 20708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:53:03.322633 20708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "3e291269c53349a6bf5de610c79be95e"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "cba06e77fc8ac9b9d53cad35b9c76f20"
server_key_iv: "642d16ab6f9fd1504becd26e1881de03"
server_key_version: "encryptionkey@0"
I20260808 17:53:03.322949 20708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "3e291269c53349a6bf5de610c79be95e"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "cba06e77fc8ac9b9d53cad35b9c76f20"
server_key_iv: "642d16ab6f9fd1504becd26e1881de03"
server_key_version: "encryptionkey@0"
I20260808 17:53:03.324347 20708 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:53:03.324971 20731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:03.325112 20708 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:53:03.325197 20708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "3e291269c53349a6bf5de610c79be95e"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "cba06e77fc8ac9b9d53cad35b9c76f20"
server_key_iv: "642d16ab6f9fd1504becd26e1881de03"
server_key_version: "encryptionkey@0"
I20260808 17:53:03.325284 20708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:53:03.339007 20708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:53:03.340548 20708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:53:03.340665 20708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:53:03.340853 20708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:53:03.341120 20708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:53:03.341152 20708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:03.341172 20708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:53:03.341195 20708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:03.346616 20708 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:38137
I20260808 17:53:03.346673 20898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:38137 every 8 connection(s)
I20260808 17:53:03.346943 20708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
Aug 08 17:53:03 dist-test-slave-bndk krb5kdc[20545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211583, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:53:03.354415 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 20708
I20260808 17:53:03.354522 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:53:03.354717 29526 external_mini_cluster.cc:1428] Setting key e18a445dd6a0e393ff16871f93ed450a
I20260808 17:53:03.355458 20680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.347666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:55617 (local address 127.28.213.190:33445)
0808 17:53:03.347731 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:03.347733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:03.347889 (+ 156us) server_negotiation.cc:407] Connection header received
0808 17:53:03.348342 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:03.348343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:03.348354 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:03.348406 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:53:03.349305 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.349831 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.350769 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.350980 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.351038 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:03.352934 (+ 1896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:53:03.352936 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:53:03.352936 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:53:03.352943 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:53:03.354051 (+ 1108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:03.354489 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:03.354490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:03.354490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:03.354551 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:03.354826 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:03.354827 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:03.354827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:03.354960 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:53:03.355025 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:03.355279 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 17:53:03.355368 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 17:53:03.355613 20902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.347620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:55617)
0808 17:53:03.347780 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:03.347814 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 17:53:03.348249 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:53:03.348457 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:53:03.348460 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:53:03.348999 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:53:03.349172 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:03.349177 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.349912 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.349912 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:03.350688 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:03.350690 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.351043 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.351045 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:03.351141 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:03.351585 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:53:03.351594 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:53:03.352850 (+ 1256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:53:03.354122 (+ 1272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:53:03.354128 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:53:03.354130 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:53:03.354424 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:53:03.354647 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:53:03.354648 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:53:03.354648 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:53:03.354762 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:53:03.355030 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:53:03.355039 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:53:03.355161 (+ 122us) client_negotiation.cc:769] Sending connection context
0808 17:53:03.355249 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 17:53:03.355392 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":95,"threads_started":1}
I20260808 17:53:03.356096 20899 heartbeater.cc:347] Connected to a master server at 127.28.213.190:33445
I20260808 17:53:03.356195 20899 heartbeater.cc:464] Registering TS with master...
I20260808 17:53:03.356374 20899 heartbeater.cc:511] Master 127.28.213.190:33445 requested a full tablet report, sending...
I20260808 17:53:03.356837 20615 ts_manager.cc:194] Registered new tserver with Master: 3e291269c53349a6bf5de610c79be95e (127.28.213.129:38137)
I20260808 17:53:03.357499 20615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:55617
WARNING: no policy specified for kudu/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
I20260808 17:53:03.383347 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:33445
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:53:03.463083 20905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:53:03.463264 20905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:53:03.463286 20905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:53:03.464362 20905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:53:03.464402 20905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:53:03.464432 20905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:53:03.465843 20905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:33445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:53:03.466051 20905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:53:03.466251 20905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:53:03.470773 20911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:53:03.470784 20914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:53:03.470788 20917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:53:03.470937 20905 server_base.cc:1034] running on GCE node
I20260808 17:53:03.471179 20905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:53:03.471419 20905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:53:03.472544 20905 hybrid_clock.cc:648] HybridClock initialized: now 1786211583472538 us; error 27 us; skew 500 ppm
Aug 08 17:53:03 dist-test-slave-bndk krb5kdc[20545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211583, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:53:03.474776 20905 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:53:03.475240 20905 webserver.cc:460] Webserver started at http://127.28.213.130:45439/ using document root <none> and password file <none>
I20260808 17:53:03.475456 20905 fs_manager.cc:359] Metadata directory not provided
I20260808 17:53:03.475500 20905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:53:03.475625 20905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:53:03.476679 20905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "bae22e4227924bac9ab9270d2e1a770b"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "fdf14a5c3cfe80187d75f6899bdb3a37"
server_key_iv: "5136439861df97c4d9034bc760085ab5"
server_key_version: "encryptionkey@0"
I20260808 17:53:03.476999 20905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "bae22e4227924bac9ab9270d2e1a770b"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "fdf14a5c3cfe80187d75f6899bdb3a37"
server_key_iv: "5136439861df97c4d9034bc760085ab5"
server_key_version: "encryptionkey@0"
I20260808 17:53:03.478266 20905 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:53:03.478909 20927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:03.479054 20905 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:03.479128 20905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "bae22e4227924bac9ab9270d2e1a770b"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "fdf14a5c3cfe80187d75f6899bdb3a37"
server_key_iv: "5136439861df97c4d9034bc760085ab5"
server_key_version: "encryptionkey@0"
I20260808 17:53:03.479195 20905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:53:03.488937 20905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:53:03.490494 20905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:53:03.490610 20905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:53:03.490797 20905 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:53:03.491055 20905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:53:03.491087 20905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:03.491106 20905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:53:03.491129 20905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:03.496519 20905 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:39925
I20260808 17:53:03.496578 21091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:39925 every 8 connection(s)
I20260808 17:53:03.496829 20905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:53:03.498066 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 20905
I20260808 17:53:03.498165 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:53:03.498343 29526 external_mini_cluster.cc:1428] Setting key d7db607616d4aa32575fdca3b1f1101d
Aug 08 17:53:03 dist-test-slave-bndk krb5kdc[20545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211583, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:53:03.505554 20680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.497460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:51841 (local address 127.28.213.190:33445)
0808 17:53:03.497506 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:03.497508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:03.497679 (+ 171us) server_negotiation.cc:407] Connection header received
0808 17:53:03.498137 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:03.498138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:03.498152 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:03.498203 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:53:03.499214 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.499700 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.500751 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.500952 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.501004 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:03.503058 (+ 2054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:53:03.503060 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:53:03.503060 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:53:03.503067 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:53:03.504284 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:03.504642 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:03.504644 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:03.504644 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:03.504700 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:03.504919 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:03.504920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:03.504920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:03.505029 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:53:03.505086 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:03.505380 (+ 294us) server_negotiation.cc:299] Negotiation successful
0808 17:53:03.505464 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:53:03.505714 21097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.497422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:51841)
0808 17:53:03.497565 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:03.497602 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 17:53:03.498033 (+ 431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:53:03.498268 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:53:03.498272 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:53:03.498930 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:53:03.499127 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:03.499132 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.499779 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.499780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:03.500654 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:03.500657 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.501023 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.501024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:03.501159 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:03.501630 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:53:03.501640 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:53:03.502969 (+ 1329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:53:03.504355 (+ 1386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:53:03.504362 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:53:03.504364 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:53:03.504576 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:53:03.504755 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:53:03.504755 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:53:03.504756 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:53:03.504858 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:53:03.505084 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:53:03.505091 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:53:03.505243 (+ 152us) client_negotiation.cc:769] Sending connection context
0808 17:53:03.505347 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 17:53:03.505505 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":70,"threads_started":1}
I20260808 17:53:03.506168 21094 heartbeater.cc:347] Connected to a master server at 127.28.213.190:33445
I20260808 17:53:03.506248 21094 heartbeater.cc:464] Registering TS with master...
I20260808 17:53:03.506417 21094 heartbeater.cc:511] Master 127.28.213.190:33445 requested a full tablet report, sending...
I20260808 17:53:03.506806 20615 ts_manager.cc:194] Registered new tserver with Master: bae22e4227924bac9ab9270d2e1a770b (127.28.213.130:39925)
WARNING: no policy specified for kudu/127.28.213.131@KRBTEST.COM; defaulting to no policy
I20260808 17:53:03.507298 20615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:51841
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
I20260808 17:53:03.523648 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:33445
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:53:03.603053 21102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:53:03.603242 21102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:53:03.603263 21102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:53:03.604390 21102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:53:03.604431 21102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:53:03.604458 21102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:53:03.605922 21102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:33445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:53:03.606137 21102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:53:03.606343 21102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:53:03.610991 21108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:53:03.611054 21109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:53:03.610991 21113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:53:03.611229 21102 server_base.cc:1034] running on GCE node
I20260808 17:53:03.611434 21102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:53:03.611652 21102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:53:03.612784 21102 hybrid_clock.cc:648] HybridClock initialized: now 1786211583612771 us; error 30 us; skew 500 ppm
Aug 08 17:53:03 dist-test-slave-bndk krb5kdc[20545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211583, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:53:03.615145 21102 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:53:03.615514 21102 webserver.cc:460] Webserver started at http://127.28.213.131:37611/ using document root <none> and password file <none>
I20260808 17:53:03.615707 21102 fs_manager.cc:359] Metadata directory not provided
I20260808 17:53:03.615746 21102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:53:03.615831 21102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:53:03.616767 21102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "a5285b2695464e61a3a17ddc6f1b3aa3"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "c071bc4cc75143fde7c41b0047260f1b"
server_key_iv: "c0b3df5c83c5dca813bbd8cfaff01c7c"
server_key_version: "encryptionkey@0"
I20260808 17:53:03.617053 21102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "a5285b2695464e61a3a17ddc6f1b3aa3"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "c071bc4cc75143fde7c41b0047260f1b"
server_key_iv: "c0b3df5c83c5dca813bbd8cfaff01c7c"
server_key_version: "encryptionkey@0"
I20260808 17:53:03.618316 21102 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:53:03.618943 21123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:03.619081 21102 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:53:03.619158 21102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "a5285b2695464e61a3a17ddc6f1b3aa3"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "c071bc4cc75143fde7c41b0047260f1b"
server_key_iv: "c0b3df5c83c5dca813bbd8cfaff01c7c"
server_key_version: "encryptionkey@0"
I20260808 17:53:03.619223 21102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:53:03.634045 21102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:53:03.635744 21102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:53:03.635859 21102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:53:03.636063 21102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:53:03.636330 21102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:53:03.636363 21102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:03.636392 21102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:53:03.636430 21102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:03.641877 21102 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:45215
I20260808 17:53:03.641947 21293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:45215 every 8 connection(s)
I20260808 17:53:03.642204 21102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
Aug 08 17:53:03 dist-test-slave-bndk krb5kdc[20545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211583, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:53:03.647882 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 21102
I20260808 17:53:03.647977 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:53:03.648147 29526 external_mini_cluster.cc:1428] Setting key ea5b9666ed7b69d7cdee312a6d0c2531
I20260808 17:53:03.650592 20680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.642844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:42317 (local address 127.28.213.190:33445)
0808 17:53:03.642913 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:03.642915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:03.643086 (+ 171us) server_negotiation.cc:407] Connection header received
0808 17:53:03.643519 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:03.643521 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:03.643531 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:03.643581 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:53:03.644411 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.644892 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.645863 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.646062 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.646110 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:03.647955 (+ 1845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:53:03.647957 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:53:03.647957 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:53:03.647965 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:53:03.649390 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:03.649744 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:03.649745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:03.649746 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:03.649803 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:03.650015 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:03.650016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:03.650016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:03.650126 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:53:03.650179 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:03.650425 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 17:53:03.650504 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 17:53:03.650751 21296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.642791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:42317)
0808 17:53:03.642977 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:03.643012 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 17:53:03.643447 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:53:03.643632 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:53:03.643635 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:53:03.644169 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:53:03.644344 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:03.644348 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.644958 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.644959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:03.645790 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:03.645792 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.646118 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.646119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:03.646216 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:03.646599 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:53:03.646607 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:53:03.647867 (+ 1260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:53:03.649469 (+ 1602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:53:03.649475 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:53:03.649477 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:53:03.649680 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:53:03.649857 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:53:03.649858 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:53:03.649858 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:53:03.649959 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:53:03.650178 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:53:03.650185 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:53:03.650311 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 17:53:03.650395 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 17:53:03.650551 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":88,"threads_started":1}
I20260808 17:53:03.651129 21294 heartbeater.cc:347] Connected to a master server at 127.28.213.190:33445
I20260808 17:53:03.651211 21294 heartbeater.cc:464] Registering TS with master...
I20260808 17:53:03.651376 21294 heartbeater.cc:511] Master 127.28.213.190:33445 requested a full tablet report, sending...
I20260808 17:53:03.651711 20615 ts_manager.cc:194] Registered new tserver with Master: a5285b2695464e61a3a17ddc6f1b3aa3 (127.28.213.131:45215)
I20260808 17:53:03.652061 20615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:42317
I20260808 17:53:03.659637 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:53:03.665784 20680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.660848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59296 (local address 127.28.213.190:33445)
0808 17:53:03.660895 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:03.660906 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:03.661000 (+ 94us) server_negotiation.cc:407] Connection header received
0808 17:53:03.661037 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:03.661038 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:03.661046 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:03.661085 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:53:03.661603 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.662046 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.662685 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.662848 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.662886 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:03.663807 (+ 921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:53:03.663808 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:53:03.663809 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:53:03.663815 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:53:03.664973 (+ 1158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:03.665211 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:03.665211 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:03.665212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:03.665275 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:03.665409 (+ 134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:03.665409 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:03.665410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:03.665525 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:53:03.665596 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:03.665663 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 17:53:03.665717 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 17:53:03.667037 20615 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59296:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:53:03.668548 20615 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:53:03.674427 21310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.670471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:39925 (local address 127.0.0.1:46034)
0808 17:53:03.670764 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:03.670804 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 17:53:03.670885 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:53:03.671161 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:53:03.671164 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:53:03.671166 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:53:03.671226 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:03.671228 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.672195 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.672196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:03.673304 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:03.673307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.674130 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.674131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:03.674211 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:03.674224 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 17:53:03.674294 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 17:53:03.674347 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":52,"threads_started":1}
I20260808 17:53:03.674429 21311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.670572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46034 (local address 127.28.213.130:39925)
0808 17:53:03.670725 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:03.670730 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:03.670894 (+ 164us) server_negotiation.cc:407] Connection header received
0808 17:53:03.670982 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:03.670985 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:03.671002 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:03.671068 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:53:03.671333 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.672052 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.673421 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.674047 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.674119 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:03.674169 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:03.674313 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 17:53:03.674353 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":87,"threads_started":1}
I20260808 17:53:03.674470 21312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.670674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49346 (local address 127.28.213.131:45215)
0808 17:53:03.670811 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:03.670815 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:03.671048 (+ 233us) server_negotiation.cc:407] Connection header received
0808 17:53:03.671108 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:03.671110 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:03.671123 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:03.671183 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:53:03.671389 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.672456 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.673561 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.674083 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.674148 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:03.674201 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:03.674367 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 17:53:03.674404 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":77,"threads_started":1}
I20260808 17:53:03.674665 21306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.670472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:45215 (local address 127.0.0.1:49346)
0808 17:53:03.670994 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:03.671002 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:53:03.671049 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:53:03.671262 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:53:03.671262 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:53:03.671264 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:53:03.671309 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:03.671310 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.672573 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.672574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:03.673483 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:03.673486 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.674233 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.674234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:03.674283 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:03.674286 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:53:03.674565 (+ 279us) client_negotiation.cc:240] Negotiation successful
0808 17:53:03.674609 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"mutex_wait_us":33,"thread_start_us":44,"threads_started":1}
I20260808 17:53:03.674814 21313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.670708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55224 (local address 127.28.213.129:38137)
0808 17:53:03.670904 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:03.670915 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:03.670926 (+ 11us) server_negotiation.cc:407] Connection header received
0808 17:53:03.670998 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:03.671000 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:03.671018 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:03.671089 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:53:03.671349 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.672457 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.673744 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.674379 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.674457 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:03.674510 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:03.674701 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 17:53:03.674743 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":76,"threads_started":1}
I20260808 17:53:03.674780 21309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.670472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:38137 (local address 127.0.0.1:55224)
0808 17:53:03.670863 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:03.670874 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:53:03.670932 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:53:03.671174 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:53:03.671175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:53:03.671177 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:53:03.671251 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:03.671253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.672567 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.672568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:03.673669 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:03.673671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.674548 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.674549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:03.674622 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:03.674625 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:53:03.674672 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 17:53:03.674713 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"mutex_wait_us":26,"spinlock_wait_cycles":768,"thread_start_us":92,"threads_started":1}
I20260808 17:53:03.675496 20996 tablet_service.cc:1467] Processing CreateTablet for tablet 6501f9e1b4e34d46998bd95887f054bc (DEFAULT_TABLE table=test-table [id=d7ade8eee96947b19e4d480932ae72e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:53:03.675542 21191 tablet_service.cc:1467] Processing CreateTablet for tablet 6501f9e1b4e34d46998bd95887f054bc (DEFAULT_TABLE table=test-table [id=d7ade8eee96947b19e4d480932ae72e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:53:03.675688 20806 tablet_service.cc:1467] Processing CreateTablet for tablet 6501f9e1b4e34d46998bd95887f054bc (DEFAULT_TABLE table=test-table [id=d7ade8eee96947b19e4d480932ae72e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:53:03.675856 21191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6501f9e1b4e34d46998bd95887f054bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:53:03.675853 20996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6501f9e1b4e34d46998bd95887f054bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:53:03.675988 20806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6501f9e1b4e34d46998bd95887f054bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:53:03.678638 21317 tablet_bootstrap.cc:492] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3: Bootstrap starting.
I20260808 17:53:03.679081 21319 tablet_bootstrap.cc:492] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b: Bootstrap starting.
I20260808 17:53:03.679353 21317 tablet_bootstrap.cc:654] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3: Neither blocks nor log segments found. Creating new log.
I20260808 17:53:03.679711 21319 tablet_bootstrap.cc:654] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b: Neither blocks nor log segments found. Creating new log.
I20260808 17:53:03.679941 21317 log.cc:824] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3: Log is configured to *not* fsync() on all Append() calls
I20260808 17:53:03.680213 21319 log.cc:824] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b: Log is configured to *not* fsync() on all Append() calls
I20260808 17:53:03.680503 21318 tablet_bootstrap.cc:492] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e: Bootstrap starting.
I20260808 17:53:03.680694 21317 tablet_bootstrap.cc:492] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3: No bootstrap required, opened a new log
I20260808 17:53:03.680768 21317 ts_tablet_manager.cc:1397] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:53:03.680882 21319 tablet_bootstrap.cc:492] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b: No bootstrap required, opened a new log
I20260808 17:53:03.680944 21319 ts_tablet_manager.cc:1397] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:53:03.681061 21318 tablet_bootstrap.cc:654] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e: Neither blocks nor log segments found. Creating new log.
I20260808 17:53:03.681594 21318 log.cc:824] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e: Log is configured to *not* fsync() on all Append() calls
I20260808 17:53:03.682281 21318 tablet_bootstrap.cc:492] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e: No bootstrap required, opened a new log
I20260808 17:53:03.682346 21318 ts_tablet_manager.cc:1397] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:53:03.682700 21317 raft_consensus.cc:348] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:03.682893 21317 raft_consensus.cc:374] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:53:03.682974 21317 raft_consensus.cc:729] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5285b2695464e61a3a17ddc6f1b3aa3, State: Initialized, Role: FOLLOWER
I20260808 17:53:03.683009 21319 raft_consensus.cc:348] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:03.683101 21317 consensus_queue.cc:260] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:03.683167 21319 raft_consensus.cc:374] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:53:03.683236 21319 raft_consensus.cc:729] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae22e4227924bac9ab9270d2e1a770b, State: Initialized, Role: FOLLOWER
I20260808 17:53:03.683354 21317 ts_tablet_manager.cc:1428] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:53:03.683355 21319 consensus_queue.cc:260] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:03.683473 21294 heartbeater.cc:503] Master 127.28.213.190:33445 was elected leader, sending a full tablet report...
I20260808 17:53:03.683656 21094 heartbeater.cc:503] Master 127.28.213.190:33445 was elected leader, sending a full tablet report...
I20260808 17:53:03.683661 21319 ts_tablet_manager.cc:1428] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:53:03.684067 21318 raft_consensus.cc:348] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:03.684204 21318 raft_consensus.cc:374] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:53:03.684226 21318 raft_consensus.cc:729] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e291269c53349a6bf5de610c79be95e, State: Initialized, Role: FOLLOWER
I20260808 17:53:03.684316 21318 consensus_queue.cc:260] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:03.684572 21318 ts_tablet_manager.cc:1428] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:53:03.684597 20899 heartbeater.cc:503] Master 127.28.213.190:33445 was elected leader, sending a full tablet report...
W20260808 17:53:03.747330 21095 tablet.cc:2369] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:53:03.845793 21328 raft_consensus.cc:482] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:53:03.845928 21328 raft_consensus.cc:504] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:03.846298 21328 leader_election.cc:288] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bae22e4227924bac9ab9270d2e1a770b (127.28.213.130:39925), 3e291269c53349a6bf5de610c79be95e (127.28.213.129:38137)
W20260808 17:53:03.847589 20900 tablet.cc:2369] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:53:03.850106 21311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.846605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:55917 (local address 127.28.213.130:39925)
0808 17:53:03.846647 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:03.846649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:03.846658 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:53:03.846682 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:03.846683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:03.846690 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:03.846738 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:53:03.846895 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.847661 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.849145 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.849756 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.849831 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:03.849840 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:03.849998 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 17:53:03.850036 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:53:03.850106 21313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.846536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:57415 (local address 127.28.213.129:38137)
0808 17:53:03.846589 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:03.846591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:03.846761 (+ 170us) server_negotiation.cc:407] Connection header received
0808 17:53:03.846794 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:03.846795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:03.846804 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:03.846850 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:53:03.846989 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.847681 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.849161 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.849756 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.849830 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:03.849840 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:03.849998 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 17:53:03.850036 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:53:03.850132 21296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.846474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:39925 (local address 127.28.213.131:55917)
0808 17:53:03.846526 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:03.846538 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:53:03.846581 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:53:03.846756 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:53:03.846757 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:53:03.846759 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:53:03.846828 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:03.846830 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.847761 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.847762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:03.849066 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:03.849067 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.849829 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.849830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:03.849934 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:03.849936 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:53:03.849984 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 17:53:03.850033 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":87}
I20260808 17:53:03.850137 21332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.846482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:38137 (local address 127.28.213.131:57415)
0808 17:53:03.846696 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:03.846705 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:53:03.846753 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:53:03.846867 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:53:03.846868 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:53:03.846870 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:53:03.846936 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:03.846937 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.847761 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.847762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:03.849062 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:03.849066 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.849829 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.849830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:03.849923 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:03.849927 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:53:03.849984 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 17:53:03.850032 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":97,"thread_start_us":116,"threads_started":1}
I20260808 17:53:03.850526 21022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6501f9e1b4e34d46998bd95887f054bc" candidate_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae22e4227924bac9ab9270d2e1a770b" is_pre_election: true
I20260808 17:53:03.850682 21022 raft_consensus.cc:2454] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5285b2695464e61a3a17ddc6f1b3aa3 in term 0.
I20260808 17:53:03.850633 20829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6501f9e1b4e34d46998bd95887f054bc" candidate_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e291269c53349a6bf5de610c79be95e" is_pre_election: true
I20260808 17:53:03.850785 20829 raft_consensus.cc:2454] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5285b2695464e61a3a17ddc6f1b3aa3 in term 0.
I20260808 17:53:03.850903 21124 leader_election.cc:302] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5285b2695464e61a3a17ddc6f1b3aa3, bae22e4227924bac9ab9270d2e1a770b; no voters:
I20260808 17:53:03.851055 21328 raft_consensus.cc:2781] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:53:03.851115 21328 raft_consensus.cc:482] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:53:03.851130 21328 raft_consensus.cc:3037] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:53:03.851822 21328 raft_consensus.cc:504] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:03.851943 21328 leader_election.cc:288] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [CANDIDATE]: Term 1 election: Requested vote from peers bae22e4227924bac9ab9270d2e1a770b (127.28.213.130:39925), 3e291269c53349a6bf5de610c79be95e (127.28.213.129:38137)
I20260808 17:53:03.852082 21022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6501f9e1b4e34d46998bd95887f054bc" candidate_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae22e4227924bac9ab9270d2e1a770b"
I20260808 17:53:03.852155 21022 raft_consensus.cc:3037] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:53:03.852155 20829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6501f9e1b4e34d46998bd95887f054bc" candidate_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e291269c53349a6bf5de610c79be95e"
I20260808 17:53:03.852231 20829 raft_consensus.cc:3037] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:53:03.852881 21022 raft_consensus.cc:2454] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5285b2695464e61a3a17ddc6f1b3aa3 in term 1.
I20260808 17:53:03.852916 20829 raft_consensus.cc:2454] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5285b2695464e61a3a17ddc6f1b3aa3 in term 1.
I20260808 17:53:03.853073 21126 leader_election.cc:302] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e291269c53349a6bf5de610c79be95e, a5285b2695464e61a3a17ddc6f1b3aa3; no voters:
I20260808 17:53:03.853183 21328 raft_consensus.cc:2781] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:53:03.853364 21328 raft_consensus.cc:686] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 1 LEADER]: Becoming Leader. State: Replica: a5285b2695464e61a3a17ddc6f1b3aa3, State: Running, Role: LEADER
I20260808 17:53:03.853456 21328 consensus_queue.cc:237] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:03.854295 20614 catalog_manager.cc:5495] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a5285b2695464e61a3a17ddc6f1b3aa3 (127.28.213.131). New cstate: current_term: 1 leader_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } health_report { overall_health: UNKNOWN } } }
W20260808 17:53:03.892676 21295 tablet.cc:2369] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:53:03.897236 21312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.895057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49348 (local address 127.28.213.131:45215)
0808 17:53:03.895103 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:03.895105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:03.895112 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:53:03.895184 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:03.895185 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:03.895203 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:03.895260 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:53:03.895374 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.895823 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.896527 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:03.896707 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:03.896760 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:03.896898 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:53:03.897004 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:53:03.897074 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:03.897111 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 17:53:03.897131 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:53:03.898808 21022 raft_consensus.cc:1261] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b [term 1 FOLLOWER]: Refusing update from remote peer a5285b2695464e61a3a17ddc6f1b3aa3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:53:03.898818 20829 raft_consensus.cc:1261] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Refusing update from remote peer a5285b2695464e61a3a17ddc6f1b3aa3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:53:03.899112 21328 consensus_queue.cc:1035] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:53:03.899250 21333 consensus_queue.cc:1035] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:53:03.903669 21337 mvcc.cc:205] Tried to move back new op lower bound from 7316322647647055872 to 7316322647464497152. Current Snapshot: MvccSnapshot[applied={T|T < 7316322647647055872 or (T in {7316322647647055872})}]
I20260808 17:53:03.904043 20614 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:53:03.904140 20614 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:53:03.904846 20614 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: Sending DeleteTablet for 3 replicas of tablet 6501f9e1b4e34d46998bd95887f054bc
I20260808 17:53:03.905181 20806 tablet_service.cc:1514] Processing DeleteTablet for tablet 6501f9e1b4e34d46998bd95887f054bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:53:03 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:55224
I20260808 17:53:03.905191 20996 tablet_service.cc:1514] Processing DeleteTablet for tablet 6501f9e1b4e34d46998bd95887f054bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:53:03 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:46034
I20260808 17:53:03.905421 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 20708
I20260808 17:53:03.905418 21191 tablet_service.cc:1514] Processing DeleteTablet for tablet 6501f9e1b4e34d46998bd95887f054bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:53:03 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:49346
I20260808 17:53:03.918656 21357 tablet_replica.cc:330] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3: stopping tablet replica
I20260808 17:53:03.918769 21357 raft_consensus.cc:2229] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:53:03.918865 21357 raft_consensus.cc:2258] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:53:03.919843 21357 ts_tablet_manager.cc:1905] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:53:03.921312 21357 ts_tablet_manager.cc:1918] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:53:03.921394 21354 tablet_replica.cc:330] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b: stopping tablet replica
I20260808 17:53:03.921448 21357 log.cc:1196] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/6501f9e1b4e34d46998bd95887f054bc
I20260808 17:53:03.921581 21354 raft_consensus.cc:2229] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:53:03.921744 21354 raft_consensus.cc:2258] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:53:03.921752 21357 ts_tablet_manager.cc:1939] T 6501f9e1b4e34d46998bd95887f054bc P a5285b2695464e61a3a17ddc6f1b3aa3: Deleting consensus metadata
I20260808 17:53:03.922183 20599 catalog_manager.cc:4841] TS a5285b2695464e61a3a17ddc6f1b3aa3 (127.28.213.131:45215): tablet 6501f9e1b4e34d46998bd95887f054bc (table test-table [id=d7ade8eee96947b19e4d480932ae72e7]) successfully deleted
I20260808 17:53:03.922386 21354 ts_tablet_manager.cc:1905] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:53:03.923585 21354 ts_tablet_manager.cc:1918] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:53:03.923650 21354 log.cc:1196] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/6501f9e1b4e34d46998bd95887f054bc
I20260808 17:53:03.923885 21354 ts_tablet_manager.cc:1939] T 6501f9e1b4e34d46998bd95887f054bc P bae22e4227924bac9ab9270d2e1a770b: Deleting consensus metadata
I20260808 17:53:03.924259 20597 catalog_manager.cc:4841] TS bae22e4227924bac9ab9270d2e1a770b (127.28.213.130:39925): tablet 6501f9e1b4e34d46998bd95887f054bc (table test-table [id=d7ade8eee96947b19e4d480932ae72e7]) successfully deleted
W20260808 17:53:03.924700 20598 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.213.129:38137 (error 108)
I20260808 17:53:03.924957 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 20905
I20260808 17:53:03.926441 21310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:03.925033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:38137 (local address 127.0.0.1:55240)
0808 17:53:03.926355 (+ 1322us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:03.926406 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.129:38137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1297}
W20260808 17:53:03.926759 20598 catalog_manager.cc:4584] TS 3e291269c53349a6bf5de610c79be95e (127.28.213.129:38137): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6501f9e1b4e34d46998bd95887f054bc: Network error: Client connection negotiation failed: client connection to 127.28.213.129:38137: connect: Connection refused (error 111)
I20260808 17:53:03.934504 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 21102
I20260808 17:53:03.941988 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 20568
I20260808 17:53:23.953390 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:33445
--webserver_interface=127.28.213.190
--webserver_port=43377
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:33445
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:53:24.037616 21362 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:53:24.037796 21362 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:53:24.037815 21362 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:53:24.038872 21362 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 17:53:24.038904 21362 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 17:53:24.038919 21362 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 17:53:24.038929 21362 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:53:24.038944 21362 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:53:24.038956 21362 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:53:24.038972 21362 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:53:24.038983 21362 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:53:24.040445 21362 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:33445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:33445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=43377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21362
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:53:24.040620 21362 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:53:24.040786 21362 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:53:24.049368 21368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:53:24.049422 21369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:53:24.049484 21371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:53:24.049434 21362 server_base.cc:1034] running on GCE node
I20260808 17:53:24.049772 21362 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:53:24.050055 21362 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:53:24.051187 21362 hybrid_clock.cc:648] HybridClock initialized: now 1786211604051178 us; error 34 us; skew 500 ppm
Aug 08 17:53:24 dist-test-slave-bndk krb5kdc[20545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211604, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:53:24.059222 21362 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:53:24.059774 21362 webserver.cc:460] Webserver started at http://127.28.213.190:43377/ using document root <none> and password file <none>
I20260808 17:53:24.060014 21362 fs_manager.cc:359] Metadata directory not provided
I20260808 17:53:24.060071 21362 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:53:24.061509 21362 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:53:24.062117 21383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:24.062275 21362 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:24.062362 21362 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "b86f6b7e29964e3db796fe7e7309acf2"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "42e8a256d731884bc8a5d1b1c9fb87fd"
server_key_iv: "b1585aa77e328071d239c6259db53990"
server_key_version: "encryptionkey@0"
I20260808 17:53:24.062745 21362 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:53:24.069947 21362 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:53:24.071552 21362 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:53:24.071674 21362 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:53:24.075526 21362 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:33445
I20260808 17:53:24.075558 21456 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:33445 every 8 connection(s)
I20260808 17:53:24.075894 21362 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:53:24.077327 21457 sys_catalog.cc:263] Verifying existing consensus state
I20260808 17:53:24.077980 21457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: Bootstrap starting.
I20260808 17:53:24.079802 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 21362
I20260808 17:53:24.080049 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:38137
--local_ip_for_outbound_sockets=127.28.213.129
--tserver_master_addrs=127.28.213.190:33445
--webserver_port=44231
--webserver_interface=127.28.213.129
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:53:24.086246 21457 log.cc:824] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: Log is configured to *not* fsync() on all Append() calls
I20260808 17:53:24.087951 21457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:53:24.088199 21457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: Bootstrap complete.
I20260808 17:53:24.090281 21457 raft_consensus.cc:348] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86f6b7e29964e3db796fe7e7309acf2" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33445 } }
I20260808 17:53:24.090498 21457 raft_consensus.cc:729] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b86f6b7e29964e3db796fe7e7309acf2, State: Initialized, Role: FOLLOWER
I20260808 17:53:24.090641 21457 consensus_queue.cc:260] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86f6b7e29964e3db796fe7e7309acf2" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33445 } }
I20260808 17:53:24.090711 21457 raft_consensus.cc:388] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:53:24.090764 21457 raft_consensus.cc:482] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:53:24.090821 21457 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 1 FOLLOWER]: Advancing to term 2
I20260808 17:53:24.091770 21457 raft_consensus.cc:504] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86f6b7e29964e3db796fe7e7309acf2" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33445 } }
I20260808 17:53:24.091872 21457 leader_election.cc:302] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b86f6b7e29964e3db796fe7e7309acf2; no voters:
I20260808 17:53:24.092028 21457 leader_election.cc:288] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 17:53:24.092085 21462 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 17:53:24.092260 21457 sys_catalog.cc:564] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:53:24.092283 21462 raft_consensus.cc:686] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 2 LEADER]: Becoming Leader. State: Replica: b86f6b7e29964e3db796fe7e7309acf2, State: Running, Role: LEADER
I20260808 17:53:24.092428 21462 consensus_queue.cc:237] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86f6b7e29964e3db796fe7e7309acf2" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33445 } }
I20260808 17:53:24.092692 21464 sys_catalog.cc:455] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b86f6b7e29964e3db796fe7e7309acf2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86f6b7e29964e3db796fe7e7309acf2" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33445 } } }
I20260808 17:53:24.092823 21465 sys_catalog.cc:455] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b86f6b7e29964e3db796fe7e7309acf2. Latest consensus state: current_term: 2 leader_uuid: "b86f6b7e29964e3db796fe7e7309acf2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86f6b7e29964e3db796fe7e7309acf2" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33445 } } }
I20260808 17:53:24.093146 21465 sys_catalog.cc:458] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [sys.catalog]: This master's current role is: LEADER
I20260808 17:53:24.093067 21464 sys_catalog.cc:458] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [sys.catalog]: This master's current role is: LEADER
I20260808 17:53:24.093998 21484 catalog_manager.cc:1259] Loaded cluster ID: 847c4444efd34a4aaa9c7cf63ab87073
I20260808 17:53:24.094036 21484 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: loading cluster ID for follower catalog manager: success
I20260808 17:53:24.094815 21484 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: acquiring CA information for follower catalog manager: success
I20260808 17:53:24.095139 21484 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 17:53:24.095227 21477 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:53:24.095566 21477 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:53:24.095659 21477 catalog_manager.cc:1259] Loaded cluster ID: 847c4444efd34a4aaa9c7cf63ab87073
I20260808 17:53:24.095714 21477 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:53:24.095897 21477 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:53:24.095974 21477 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: Loaded TSK: 0
I20260808 17:53:24.104287 21477 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: Generated new TSK 1
I20260808 17:53:24.104370 21477 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 17:53:24.171604 21459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:53:24.171798 21459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:53:24.171831 21459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:53:24.172937 21459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:53:24.172976 21459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:53:24.173012 21459 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:53:24.174467 21459 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:38137
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=44231
--tserver_master_addrs=127.28.213.190:33445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:53:24.174692 21459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:53:24.174924 21459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:53:24.179603 21493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:53:24.179610 21492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:53:24.179621 21495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:53:24.180008 21459 server_base.cc:1034] running on GCE node
I20260808 17:53:24.180179 21459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:53:24.180384 21459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:53:24.181521 21459 hybrid_clock.cc:648] HybridClock initialized: now 1786211604181508 us; error 31 us; skew 500 ppm
Aug 08 17:53:24 dist-test-slave-bndk krb5kdc[20545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211604, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:53:24.183960 21459 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:53:24.184384 21459 webserver.cc:460] Webserver started at http://127.28.213.129:44231/ using document root <none> and password file <none>
I20260808 17:53:24.184602 21459 fs_manager.cc:359] Metadata directory not provided
I20260808 17:53:24.184666 21459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:53:24.186022 21459 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:53:24.186645 21507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:24.186817 21459 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:53:24.186897 21459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "3e291269c53349a6bf5de610c79be95e"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "cba06e77fc8ac9b9d53cad35b9c76f20"
server_key_iv: "642d16ab6f9fd1504becd26e1881de03"
server_key_version: "encryptionkey@0"
I20260808 17:53:24.187197 21459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:53:24.202718 21459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:53:24.204663 21459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:53:24.204789 21459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:53:24.204998 21459 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:53:24.205507 21517 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 17:53:24.206871 21459 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 17:53:24.206920 21459 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 17:53:24.206943 21459 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 17:53:24.207572 21459 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 17:53:24.207614 21459 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 17:53:24.207688 21517 tablet_bootstrap.cc:492] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e: Bootstrap starting.
I20260808 17:53:24.214800 21459 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:38137
I20260808 17:53:24.214874 21668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:38137 every 8 connection(s)
I20260808 17:53:24.215395 21459 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:53:24.218384 21517 log.cc:824] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e: Log is configured to *not* fsync() on all Append() calls
I20260808 17:53:24.220441 21517 tablet_bootstrap.cc:492] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:53:24.220728 21517 tablet_bootstrap.cc:492] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e: Bootstrap complete.
I20260808 17:53:24.221709 21517 ts_tablet_manager.cc:1397] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.007s
I20260808 17:53:24.222899 21517 raft_consensus.cc:348] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:24.223207 21517 raft_consensus.cc:729] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e291269c53349a6bf5de610c79be95e, State: Initialized, Role: FOLLOWER
I20260808 17:53:24.223376 21517 consensus_queue.cc:260] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:24.223665 21517 ts_tablet_manager.cc:1428] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
Aug 08 17:53:24 dist-test-slave-bndk krb5kdc[20545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211604, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:53:24.225615 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 21459
I20260808 17:53:24.225863 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:39925
--local_ip_for_outbound_sockets=127.28.213.130
--tserver_master_addrs=127.28.213.190:33445
--webserver_port=45439
--webserver_interface=127.28.213.130
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:53:24.228049 21671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.216198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:39111)
0808 17:53:24.216560 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:24.216605 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 17:53:24.217208 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:53:24.217788 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:53:24.217793 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:53:24.218141 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:53:24.218386 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:24.218393 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.220053 (+ 1660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.220055 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:24.221310 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:24.221313 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.222074 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.222075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:24.222228 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.222772 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:53:24.222781 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:53:24.224298 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:53:24.226309 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:53:24.226317 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:53:24.226319 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:53:24.226602 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:53:24.226865 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:53:24.226866 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:53:24.226866 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:53:24.227008 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:53:24.227460 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:53:24.227467 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:53:24.227606 (+ 139us) client_negotiation.cc:769] Sending connection context
0808 17:53:24.227706 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 17:53:24.227857 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":98,"threads_started":1}
I20260808 17:53:24.228120 21673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.216269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:39111 (local address 127.28.213.190:33445)
0808 17:53:24.216466 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:24.216474 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:24.216751 (+ 277us) server_negotiation.cc:407] Connection header received
0808 17:53:24.217491 (+ 740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:24.217502 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:24.217571 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:24.217747 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:53:24.218527 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.219909 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.221388 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.221971 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.222071 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.224389 (+ 2318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:53:24.224394 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:53:24.224394 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:53:24.224406 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:53:24.226215 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:24.226681 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:24.226684 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:24.226685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:24.226799 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:24.227068 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:24.227069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:24.227069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:24.227355 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:53:24.227429 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:24.227797 (+ 368us) server_negotiation.cc:299] Negotiation successful
0808 17:53:24.227942 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":94,"threads_started":1}
I20260808 17:53:24.229290 21669 heartbeater.cc:347] Connected to a master server at 127.28.213.190:33445
I20260808 17:53:24.229378 21669 heartbeater.cc:464] Registering TS with master...
I20260808 17:53:24.229537 21669 heartbeater.cc:511] Master 127.28.213.190:33445 requested a full tablet report, sending...
I20260808 17:53:24.230242 21405 ts_manager.cc:194] Registered new tserver with Master: 3e291269c53349a6bf5de610c79be95e (127.28.213.129:38137)
I20260808 17:53:24.231477 21405 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:39111
I20260808 17:53:24.232316 21669 heartbeater.cc:503] Master 127.28.213.190:33445 was elected leader, sending a full tablet report...
Aug 08 17:53:24 dist-test-slave-bndk krb5kdc[20545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211604, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for kudu/127.28.213.129@KRBTEST.COM
I20260808 17:53:24.238517 21677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.230850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:38137 (local address 127.0.0.1:43394)
0808 17:53:24.231077 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:24.231109 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 17:53:24.231180 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:53:24.231356 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:53:24.231361 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:53:24.231657 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:53:24.231706 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:24.231709 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.232868 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.232869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:24.233435 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:24.233437 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.234005 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.234006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:24.234050 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.234461 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:53:24.234464 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:53:24.235818 (+ 1354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:53:24.237597 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:53:24.237603 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:53:24.237605 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:53:24.237788 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:53:24.237970 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:53:24.237970 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:53:24.237971 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:53:24.238017 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:53:24.238269 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:53:24.238272 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:53:24.238309 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 17:53:24.238364 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 17:53:24.238454 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":95,"threads_started":1}
I20260808 17:53:24.238596 21678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.230915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43394 (local address 127.28.213.129:38137)
0808 17:53:24.231066 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:24.231070 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:24.231178 (+ 108us) server_negotiation.cc:407] Connection header received
0808 17:53:24.231264 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:24.231266 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:24.231293 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:24.231348 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:53:24.231780 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.232789 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.233507 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.233933 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.234012 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.235903 (+ 1891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:53:24.235912 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:53:24.235913 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:53:24.235920 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:53:24.237526 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:24.237855 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:24.237858 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:24.237858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:24.237916 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:24.238063 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:24.238063 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:24.238064 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:24.238217 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:53:24.238291 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:24.238419 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 17:53:24.238508 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":71,"threads_started":1}
I20260808 17:53:24.239018 21572 tablet_service.cc:1514] Processing DeleteTablet for tablet 6501f9e1b4e34d46998bd95887f054bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:53:03 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:43394
I20260808 17:53:24.239454 21679 tablet_replica.cc:330] stopping tablet replica
I20260808 17:53:24.239557 21679 raft_consensus.cc:2229] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:53:24.239617 21679 raft_consensus.cc:2258] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:53:24.239892 21679 ts_tablet_manager.cc:1905] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:53:24.241685 21679 ts_tablet_manager.cc:1918] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:53:24.241747 21679 log.cc:1196] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/wal/wals/6501f9e1b4e34d46998bd95887f054bc
I20260808 17:53:24.241943 21679 ts_tablet_manager.cc:1939] T 6501f9e1b4e34d46998bd95887f054bc P 3e291269c53349a6bf5de610c79be95e: Deleting consensus metadata
I20260808 17:53:24.242376 21389 catalog_manager.cc:4841] TS 3e291269c53349a6bf5de610c79be95e (127.28.213.129:38137): tablet 6501f9e1b4e34d46998bd95887f054bc (table test-table [id=d7ade8eee96947b19e4d480932ae72e7]) successfully deleted
W20260808 17:53:24.308518 21676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:53:24.308702 21676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:53:24.308724 21676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:53:24.309795 21676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:53:24.309828 21676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:53:24.309852 21676 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:53:24.311201 21676 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:39925
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=45439
--tserver_master_addrs=127.28.213.190:33445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:53:24.311395 21676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:53:24.311569 21676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:53:24.316092 21688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:53:24.316099 21692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:53:24.316099 21689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:53:24.316133 21676 server_base.cc:1034] running on GCE node
I20260808 17:53:24.316422 21676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:53:24.316618 21676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:53:24.317745 21676 hybrid_clock.cc:648] HybridClock initialized: now 1786211604317731 us; error 28 us; skew 500 ppm
Aug 08 17:53:24 dist-test-slave-bndk krb5kdc[20545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211604, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:53:24.320034 21676 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:53:24.320431 21676 webserver.cc:460] Webserver started at http://127.28.213.130:45439/ using document root <none> and password file <none>
I20260808 17:53:24.320623 21676 fs_manager.cc:359] Metadata directory not provided
I20260808 17:53:24.320675 21676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:53:24.321941 21676 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260808 17:53:24.322486 21703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:24.322639 21676 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:53:24.322717 21676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "bae22e4227924bac9ab9270d2e1a770b"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "fdf14a5c3cfe80187d75f6899bdb3a37"
server_key_iv: "5136439861df97c4d9034bc760085ab5"
server_key_version: "encryptionkey@0"
I20260808 17:53:24.323030 21676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:53:24.336647 21676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:53:24.338624 21676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:53:24.338727 21676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:53:24.338887 21676 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:53:24.339131 21676 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:53:24.339161 21676 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:24.339180 21676 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:53:24.339195 21676 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:24.344632 21676 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:39925
I20260808 17:53:24.344672 21886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:39925 every 8 connection(s)
I20260808 17:53:24.344964 21676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
Aug 08 17:53:24 dist-test-slave-bndk krb5kdc[20545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211604, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:53:24.351558 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 21676
I20260808 17:53:24.351795 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:45215
--local_ip_for_outbound_sockets=127.28.213.131
--tserver_master_addrs=127.28.213.190:33445
--webserver_port=37611
--webserver_interface=127.28.213.131
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:53:24.353116 21673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.345593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:39951 (local address 127.28.213.190:33445)
0808 17:53:24.345673 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:24.345676 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:24.345840 (+ 164us) server_negotiation.cc:407] Connection header received
0808 17:53:24.346283 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:24.346284 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:24.346296 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:24.346345 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:53:24.347186 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.347666 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.348569 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.348759 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.348801 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.350643 (+ 1842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:53:24.350645 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:53:24.350645 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:53:24.350652 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:53:24.351899 (+ 1247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:24.352313 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:24.352314 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:24.352314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:24.352362 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:24.352590 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:24.352591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:24.352591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:24.352682 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:53:24.352725 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:24.352989 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 17:53:24.353055 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 17:53:24.353335 21889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.345579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:39951)
0808 17:53:24.345729 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:24.345762 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 17:53:24.346207 (+ 445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:53:24.346407 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:53:24.346410 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:53:24.346939 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:53:24.347120 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:24.347124 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.347729 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.347730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:24.348508 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:24.348511 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.348810 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.348810 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:24.348909 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.349315 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:53:24.349324 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:53:24.350560 (+ 1236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:53:24.351988 (+ 1428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:53:24.351996 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:53:24.351998 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:53:24.352242 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:53:24.352413 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:53:24.352414 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:53:24.352414 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:53:24.352539 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:53:24.352728 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:53:24.352733 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:53:24.352873 (+ 140us) client_negotiation.cc:769] Sending connection context
0808 17:53:24.352968 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 17:53:24.353111 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":81,"threads_started":1}
I20260808 17:53:24.353866 21887 heartbeater.cc:347] Connected to a master server at 127.28.213.190:33445
I20260808 17:53:24.353960 21887 heartbeater.cc:464] Registering TS with master...
I20260808 17:53:24.354117 21887 heartbeater.cc:511] Master 127.28.213.190:33445 requested a full tablet report, sending...
I20260808 17:53:24.354497 21405 ts_manager.cc:194] Registered new tserver with Master: bae22e4227924bac9ab9270d2e1a770b (127.28.213.130:39925)
I20260808 17:53:24.354970 21405 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:39951
W20260808 17:53:24.432322 21890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:53:24.432504 21890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:53:24.432536 21890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:53:24.433633 21890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:53:24.433673 21890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:53:24.433707 21890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:53:24.435101 21890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:45215
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=37611
--tserver_master_addrs=127.28.213.190:33445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:53:24.435312 21890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:53:24.435513 21890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:53:24.440112 21897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:53:24.440119 21890 server_base.cc:1034] running on GCE node
W20260808 17:53:24.440104 21904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:53:24.440104 21896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:53:24.440486 21890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:53:24.440711 21890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:53:24.441840 21890 hybrid_clock.cc:648] HybridClock initialized: now 1786211604441824 us; error 27 us; skew 500 ppm
Aug 08 17:53:24 dist-test-slave-bndk krb5kdc[20545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211604, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:53:24.444140 21890 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:53:24.444535 21890 webserver.cc:460] Webserver started at http://127.28.213.131:37611/ using document root <none> and password file <none>
I20260808 17:53:24.444736 21890 fs_manager.cc:359] Metadata directory not provided
I20260808 17:53:24.444798 21890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:53:24.446044 21890 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:53:24.446552 21912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:24.446687 21890 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:24.446765 21890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "a5285b2695464e61a3a17ddc6f1b3aa3"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "c071bc4cc75143fde7c41b0047260f1b"
server_key_iv: "c0b3df5c83c5dca813bbd8cfaff01c7c"
server_key_version: "encryptionkey@0"
I20260808 17:53:24.447048 21890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:53:24.466184 21890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:53:24.468130 21890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:53:24.468257 21890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:53:24.468451 21890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:53:24.468715 21890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:53:24.468748 21890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:24.468775 21890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:53:24.468791 21890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:24.474157 21890 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:45215
I20260808 17:53:24.474195 22076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:45215 every 8 connection(s)
I20260808 17:53:24.474490 21890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:53:24.478073 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 21890
Aug 08 17:53:24 dist-test-slave-bndk krb5kdc[20545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211604, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:53:24.483587 21673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.475150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:41979 (local address 127.28.213.190:33445)
0808 17:53:24.475213 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:24.475214 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:24.475391 (+ 177us) server_negotiation.cc:407] Connection header received
0808 17:53:24.475855 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:24.475857 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:24.475869 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:24.475920 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:53:24.476798 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.477338 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.478551 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.478837 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.478885 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.480930 (+ 2045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:53:24.480932 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:53:24.480932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:53:24.480937 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:53:24.482403 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:24.482776 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:24.482777 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:24.482777 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:24.482827 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:24.483052 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:24.483052 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:24.483053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:24.483172 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:53:24.483234 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:24.483455 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 17:53:24.483524 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 17:53:24.483779 22080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.475122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:41979)
0808 17:53:24.475280 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:24.475314 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 17:53:24.475758 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:53:24.475996 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:53:24.475999 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:53:24.476526 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:53:24.476697 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:24.476701 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.477425 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.477426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:24.478350 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:24.478354 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.478921 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.478922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:24.479067 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.479497 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:53:24.479505 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:53:24.480843 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:53:24.482488 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:53:24.482494 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:53:24.482496 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:53:24.482702 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:53:24.482890 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:53:24.482892 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:53:24.482892 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:53:24.482993 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:53:24.483234 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:53:24.483238 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:53:24.483339 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 17:53:24.483419 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 17:53:24.483569 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":83,"threads_started":1}
I20260808 17:53:24.484225 22077 heartbeater.cc:347] Connected to a master server at 127.28.213.190:33445
I20260808 17:53:24.484328 22077 heartbeater.cc:464] Registering TS with master...
I20260808 17:53:24.484517 22077 heartbeater.cc:511] Master 127.28.213.190:33445 requested a full tablet report, sending...
I20260808 17:53:24.484540 22082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.478447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54130 (local address 127.28.213.190:33445)
0808 17:53:24.478573 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:24.478575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:24.478620 (+ 45us) server_negotiation.cc:407] Connection header received
0808 17:53:24.478667 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:24.478668 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:24.478679 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:24.478744 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:53:24.479402 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.479881 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.480662 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.480848 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.480897 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.482076 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:53:24.482077 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:53:24.482078 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:53:24.482084 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:53:24.483399 (+ 1315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:24.483747 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:24.483747 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:24.483748 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:24.483800 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:24.484068 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:24.484069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:24.484069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:24.484194 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:53:24.484336 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:24.484400 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 17:53:24.484481 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":63,"threads_started":1}
I20260808 17:53:24.484887 21405 ts_manager.cc:194] Registered new tserver with Master: a5285b2695464e61a3a17ddc6f1b3aa3 (127.28.213.131:45215)
I20260808 17:53:24.485272 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:53:24.485324 21405 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:41979
I20260808 17:53:24.488083 22082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.485581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54142 (local address 127.28.213.190:33445)
0808 17:53:24.485614 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:24.485615 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:24.486094 (+ 479us) server_negotiation.cc:407] Connection header received
0808 17:53:24.486151 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:24.486152 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:24.486189 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:24.486245 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:53:24.486336 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.486774 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.487479 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.487673 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.487723 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.487865 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:53:24.487908 (+ 43us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 17:53:24.488030 (+ 122us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54142: token expired
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 17:53:24.488137 22082 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54142: token expired
W20260808 17:53:24.488296 21302 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.28.213.190:33445)
I20260808 17:53:24.493186 22082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.488486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54144 (local address 127.28.213.190:33445)
0808 17:53:24.488516 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:24.488518 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:24.488525 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:53:24.488582 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:24.488582 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:24.488588 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:24.488618 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:53:24.488991 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.489447 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.490128 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.490294 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.490333 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.491257 (+ 924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:53:24.491258 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:53:24.491258 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:53:24.491262 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:53:24.492357 (+ 1095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:24.492629 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:24.492629 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:24.492630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:24.492670 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:24.492791 (+ 121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:24.492792 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:24.492792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:24.492874 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:53:24.492946 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:24.493062 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 17:53:24.493134 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13}
I20260808 17:53:24.494251 21405 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54144:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:53:24.495703 21405 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:53:24.497601 21572 tablet_service.cc:1467] Processing CreateTablet for tablet 864b7d4d60fc4ff7b5ed979488ce62cc (DEFAULT_TABLE table=test-table [id=778b254ff3114f43a6fefa0e78b79662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:53:24.497807 21572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 864b7d4d60fc4ff7b5ed979488ce62cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:53:24.499349 21517 tablet_bootstrap.cc:492] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e: Bootstrap starting.
I20260808 17:53:24.499673 21517 tablet_bootstrap.cc:654] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e: Neither blocks nor log segments found. Creating new log.
I20260808 17:53:24.500331 21517 tablet_bootstrap.cc:492] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e: No bootstrap required, opened a new log
I20260808 17:53:24.500377 21517 ts_tablet_manager.cc:1397] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260808 17:53:24.500715 21517 raft_consensus.cc:348] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:24.500785 21677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.497328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:45215 (local address 127.0.0.1:42156)
0808 17:53:24.497357 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:24.497367 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:53:24.497412 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:53:24.497936 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:53:24.497937 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:53:24.497939 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:53:24.497977 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:24.497978 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.498858 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.498859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:24.499718 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:24.499723 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.500543 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.500544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:24.500606 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.500626 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 17:53:24.500678 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 17:53:24.500720 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260808 17:53:24.500799 22085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.497612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42156 (local address 127.28.213.131:45215)
0808 17:53:24.497773 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:24.497777 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:24.497786 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:53:24.497817 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:24.497819 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:24.497833 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:24.497912 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:53:24.498054 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.498785 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.499814 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.500489 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.500547 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.500600 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:24.500694 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 17:53:24.500731 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":75,"threads_started":1}
I20260808 17:53:24.500787 21517 raft_consensus.cc:374] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:53:24.500828 21517 raft_consensus.cc:729] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e291269c53349a6bf5de610c79be95e, State: Initialized, Role: FOLLOWER
I20260808 17:53:24.500875 21517 consensus_queue.cc:260] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:24.500958 21517 ts_tablet_manager.cc:1428] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 17:53:24.501529 22084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.497371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:39925 (local address 127.0.0.1:60862)
0808 17:53:24.497512 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:24.497522 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:53:24.497569 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:53:24.498188 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:53:24.498189 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:53:24.498191 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:53:24.498285 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:24.498287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.499456 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.499457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:24.500410 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:24.500413 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.501307 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.501308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:24.501368 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.501372 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:53:24.501428 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 17:53:24.501466 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":95,"threads_started":1}
I20260808 17:53:24.501752 22087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.497618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60862 (local address 127.28.213.130:39925)
0808 17:53:24.498035 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:24.498040 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:24.498048 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:53:24.498085 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:24.498087 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:24.498102 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:24.498184 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:53:24.498366 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.499363 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.500484 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.501205 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.501306 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.501354 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:24.501635 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 17:53:24.501679 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":89,"threads_started":1}
I20260808 17:53:24.502012 21984 tablet_service.cc:1467] Processing CreateTablet for tablet 864b7d4d60fc4ff7b5ed979488ce62cc (DEFAULT_TABLE table=test-table [id=778b254ff3114f43a6fefa0e78b79662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:53:24.502283 21984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 864b7d4d60fc4ff7b5ed979488ce62cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:53:24.502367 21778 tablet_service.cc:1467] Processing CreateTablet for tablet 864b7d4d60fc4ff7b5ed979488ce62cc (DEFAULT_TABLE table=test-table [id=778b254ff3114f43a6fefa0e78b79662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:53:24.502661 21778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 864b7d4d60fc4ff7b5ed979488ce62cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:53:24.504745 22090 tablet_bootstrap.cc:492] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3: Bootstrap starting.
I20260808 17:53:24.505168 22093 tablet_bootstrap.cc:492] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b: Bootstrap starting.
I20260808 17:53:24.505475 22090 tablet_bootstrap.cc:654] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3: Neither blocks nor log segments found. Creating new log.
I20260808 17:53:24.505821 22093 tablet_bootstrap.cc:654] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b: Neither blocks nor log segments found. Creating new log.
I20260808 17:53:24.505973 22090 log.cc:824] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3: Log is configured to *not* fsync() on all Append() calls
I20260808 17:53:24.506295 22093 log.cc:824] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b: Log is configured to *not* fsync() on all Append() calls
I20260808 17:53:24.506649 22090 tablet_bootstrap.cc:492] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3: No bootstrap required, opened a new log
I20260808 17:53:24.506726 22090 ts_tablet_manager.cc:1397] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:53:24.506979 22093 tablet_bootstrap.cc:492] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b: No bootstrap required, opened a new log
I20260808 17:53:24.507038 22093 ts_tablet_manager.cc:1397] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 17:53:24.508168 22090 raft_consensus.cc:348] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:24.508294 22090 raft_consensus.cc:374] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:53:24.508315 22090 raft_consensus.cc:729] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5285b2695464e61a3a17ddc6f1b3aa3, State: Initialized, Role: FOLLOWER
I20260808 17:53:24.508409 22090 consensus_queue.cc:260] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:24.508654 22090 ts_tablet_manager.cc:1428] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:53:24.508569 22093 raft_consensus.cc:348] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:24.508678 22077 heartbeater.cc:503] Master 127.28.213.190:33445 was elected leader, sending a full tablet report...
I20260808 17:53:24.508713 22093 raft_consensus.cc:374] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:53:24.508757 22093 raft_consensus.cc:729] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae22e4227924bac9ab9270d2e1a770b, State: Initialized, Role: FOLLOWER
I20260808 17:53:24.508864 22093 consensus_queue.cc:260] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:24.509131 22093 ts_tablet_manager.cc:1428] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 17:53:24.509150 21887 heartbeater.cc:503] Master 127.28.213.190:33445 was elected leader, sending a full tablet report...
W20260808 17:53:24.595466 21888 tablet.cc:2369] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:53:24.716147 21670 tablet.cc:2369] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:53:24.724990 22079 tablet.cc:2369] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:53:24.827847 22101 raft_consensus.cc:482] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:53:24.827981 22101 raft_consensus.cc:504] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:24.828353 22101 leader_election.cc:288] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5285b2695464e61a3a17ddc6f1b3aa3 (127.28.213.131:45215), 3e291269c53349a6bf5de610c79be95e (127.28.213.129:38137)
I20260808 17:53:24.831904 22085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.828568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:41223 (local address 127.28.213.131:45215)
0808 17:53:24.828623 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:24.828625 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:24.828637 (+ 12us) server_negotiation.cc:407] Connection header received
0808 17:53:24.828692 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:24.828693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:24.828703 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:24.828766 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:53:24.828913 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.829671 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.831005 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.831555 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.831627 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.831637 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:24.831786 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 17:53:24.831826 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:53:24.831899 22104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.828661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:40815 (local address 127.28.213.129:38137)
0808 17:53:24.828757 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:24.828759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:24.828766 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:53:24.828790 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:24.828791 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:24.828818 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:24.828884 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:53:24.829027 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.829751 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.830996 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.831614 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.831678 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.831734 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:24.831789 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 17:53:24.831831 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77,"thread_start_us":44,"threads_started":1}
I20260808 17:53:24.831903 21889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.828520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:45215 (local address 127.28.213.130:41223)
0808 17:53:24.828573 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:24.828584 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:53:24.828625 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:53:24.828775 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:53:24.828776 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:53:24.828777 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:53:24.828839 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:24.828841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.829738 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.829739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:24.830914 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:24.830917 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.831627 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.831628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:24.831715 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.831719 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:53:24.831773 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 17:53:24.831810 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":4}
I20260808 17:53:24.831920 22103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.828532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:38137 (local address 127.28.213.130:40815)
0808 17:53:24.828625 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:24.828634 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:53:24.828675 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:53:24.828902 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:53:24.828903 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:53:24.828904 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:53:24.828967 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:24.828968 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.829814 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.829815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:24.830919 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:24.830920 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.831682 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.831682 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:24.831738 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.831740 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:53:24.831786 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 17:53:24.831815 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":58,"threads_started":1}
I20260808 17:53:24.832304 22011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "864b7d4d60fc4ff7b5ed979488ce62cc" candidate_uuid: "bae22e4227924bac9ab9270d2e1a770b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" is_pre_election: true
I20260808 17:53:24.832434 22011 raft_consensus.cc:2454] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae22e4227924bac9ab9270d2e1a770b in term 0.
I20260808 17:53:24.832376 21600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "864b7d4d60fc4ff7b5ed979488ce62cc" candidate_uuid: "bae22e4227924bac9ab9270d2e1a770b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e291269c53349a6bf5de610c79be95e" is_pre_election: true
I20260808 17:53:24.832523 21600 raft_consensus.cc:2454] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae22e4227924bac9ab9270d2e1a770b in term 0.
I20260808 17:53:24.832692 21709 leader_election.cc:302] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5285b2695464e61a3a17ddc6f1b3aa3, bae22e4227924bac9ab9270d2e1a770b; no voters:
I20260808 17:53:24.832857 22101 raft_consensus.cc:2781] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:53:24.832898 22101 raft_consensus.cc:482] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:53:24.832916 22101 raft_consensus.cc:3037] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:53:24.833606 22101 raft_consensus.cc:504] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:24.833714 22101 leader_election.cc:288] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [CANDIDATE]: Term 1 election: Requested vote from peers a5285b2695464e61a3a17ddc6f1b3aa3 (127.28.213.131:45215), 3e291269c53349a6bf5de610c79be95e (127.28.213.129:38137)
I20260808 17:53:24.833864 22011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "864b7d4d60fc4ff7b5ed979488ce62cc" candidate_uuid: "bae22e4227924bac9ab9270d2e1a770b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3"
I20260808 17:53:24.833865 21600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "864b7d4d60fc4ff7b5ed979488ce62cc" candidate_uuid: "bae22e4227924bac9ab9270d2e1a770b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e291269c53349a6bf5de610c79be95e"
I20260808 17:53:24.833935 22011 raft_consensus.cc:3037] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:53:24.833940 21600 raft_consensus.cc:3037] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:53:24.834583 21600 raft_consensus.cc:2454] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae22e4227924bac9ab9270d2e1a770b in term 1.
I20260808 17:53:24.834599 22011 raft_consensus.cc:2454] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae22e4227924bac9ab9270d2e1a770b in term 1.
I20260808 17:53:24.834729 21709 leader_election.cc:302] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5285b2695464e61a3a17ddc6f1b3aa3, bae22e4227924bac9ab9270d2e1a770b; no voters:
I20260808 17:53:24.834852 22101 raft_consensus.cc:2781] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:53:24.834986 22101 raft_consensus.cc:686] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [term 1 LEADER]: Becoming Leader. State: Replica: bae22e4227924bac9ab9270d2e1a770b, State: Running, Role: LEADER
I20260808 17:53:24.835079 22101 consensus_queue.cc:237] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:24.835825 21405 catalog_manager.cc:5495] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b reported cstate change: term changed from 0 to 1, leader changed from <none> to bae22e4227924bac9ab9270d2e1a770b (127.28.213.130). New cstate: current_term: 1 leader_uuid: "bae22e4227924bac9ab9270d2e1a770b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } health_report { overall_health: UNKNOWN } } }
I20260808 17:53:24.855046 22087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.852878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60866 (local address 127.28.213.130:39925)
0808 17:53:24.852919 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:24.852921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:24.852929 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:53:24.852992 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:24.852993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:24.853010 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:24.853067 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:53:24.853172 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.853668 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.854360 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:24.854551 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:24.854604 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:24.854745 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:53:24.854836 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:53:24.854905 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:24.854942 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 17:53:24.854961 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:53:24.856539 22011 raft_consensus.cc:1261] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 1 FOLLOWER]: Refusing update from remote peer bae22e4227924bac9ab9270d2e1a770b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:53:24.856539 21600 raft_consensus.cc:1261] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Refusing update from remote peer bae22e4227924bac9ab9270d2e1a770b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:53:24.856850 22105 consensus_queue.cc:1035] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:53:24.856966 22101 consensus_queue.cc:1035] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:53:24.859035 22110 mvcc.cc:205] Tried to move back new op lower bound from 7316322733490196480 to 7316322733404971008. Current Snapshot: MvccSnapshot[applied={T|T < 7316322733490196480}]
I20260808 17:53:24.859279 22114 mvcc.cc:205] Tried to move back new op lower bound from 7316322733490196480 to 7316322733404971008. Current Snapshot: MvccSnapshot[applied={T|T < 7316322733490196480}]
I20260808 17:53:24.859601 22109 mvcc.cc:205] Tried to move back new op lower bound from 7316322733490196480 to 7316322733404971008. Current Snapshot: MvccSnapshot[applied={T|T < 7316322733490196480 or (T in {7316322733490196480})}]
I20260808 17:53:24.860903 21405 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:53:24.860980 21405 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:53:24.861719 21405 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: Sending DeleteTablet for 3 replicas of tablet 864b7d4d60fc4ff7b5ed979488ce62cc
I20260808 17:53:24.862025 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 21459
I20260808 17:53:24.862032 21984 tablet_service.cc:1514] Processing DeleteTablet for tablet 864b7d4d60fc4ff7b5ed979488ce62cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:53:24 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:42156
I20260808 17:53:24.862197 21572 tablet_service.cc:1514] Processing DeleteTablet for tablet 864b7d4d60fc4ff7b5ed979488ce62cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:53:24 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:43394
I20260808 17:53:24.877873 21778 tablet_service.cc:1514] Processing DeleteTablet for tablet 864b7d4d60fc4ff7b5ed979488ce62cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:53:24 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:60862
I20260808 17:53:24.878594 22121 tablet_replica.cc:330] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3: stopping tablet replica
I20260808 17:53:24.878690 22121 raft_consensus.cc:2229] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:53:24.878784 22121 raft_consensus.cc:2258] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:53:24.879110 22122 tablet_replica.cc:330] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b: stopping tablet replica
I20260808 17:53:24.879237 22121 ts_tablet_manager.cc:1905] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:53:24.879254 22122 raft_consensus.cc:2229] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:53:24.879344 22122 raft_consensus.cc:2258] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:53:24.879786 22122 ts_tablet_manager.cc:1905] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:53:24.880920 22121 ts_tablet_manager.cc:1918] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:53:24.881039 22121 log.cc:1196] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/864b7d4d60fc4ff7b5ed979488ce62cc
I20260808 17:53:24.881399 22121 ts_tablet_manager.cc:1939] T 864b7d4d60fc4ff7b5ed979488ce62cc P a5285b2695464e61a3a17ddc6f1b3aa3: Deleting consensus metadata
I20260808 17:53:24.881444 22122 ts_tablet_manager.cc:1918] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:53:24.881582 22122 log.cc:1196] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/864b7d4d60fc4ff7b5ed979488ce62cc
I20260808 17:53:24.881899 22122 ts_tablet_manager.cc:1939] T 864b7d4d60fc4ff7b5ed979488ce62cc P bae22e4227924bac9ab9270d2e1a770b: Deleting consensus metadata
I20260808 17:53:24.881877 21390 catalog_manager.cc:4841] TS a5285b2695464e61a3a17ddc6f1b3aa3 (127.28.213.131:45215): tablet 864b7d4d60fc4ff7b5ed979488ce62cc (table test-table [id=778b254ff3114f43a6fefa0e78b79662]) successfully deleted
I20260808 17:53:24.882332 21384 catalog_manager.cc:4841] TS bae22e4227924bac9ab9270d2e1a770b (127.28.213.130:39925): tablet 864b7d4d60fc4ff7b5ed979488ce62cc (table test-table [id=778b254ff3114f43a6fefa0e78b79662]) successfully deleted
W20260808 17:53:24.883569 21389 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.213.129:38137 (error 108)
I20260808 17:53:24.883939 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 21676
I20260808 17:53:24.884017 22084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:24.883886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:38137 (local address 127.0.0.1:43402)
0808 17:53:24.883943 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:24.883987 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.129:38137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 17:53:24.888491 21389 catalog_manager.cc:4584] TS 3e291269c53349a6bf5de610c79be95e (127.28.213.129:38137): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 864b7d4d60fc4ff7b5ed979488ce62cc: Network error: Client connection negotiation failed: client connection to 127.28.213.129:38137: connect: Connection refused (error 111)
I20260808 17:53:24.893232 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 21890
I20260808 17:53:24.901731 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 21362
I20260808 17:53:44.913470 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:33445
--webserver_interface=127.28.213.190
--webserver_port=43377
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:33445
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:53:45.009872 22125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:53:45.010068 22125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:53:45.010088 22125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:53:45.011211 22125 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 17:53:45.011253 22125 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 17:53:45.011265 22125 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 17:53:45.011310 22125 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:53:45.011329 22125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:53:45.011345 22125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:53:45.011366 22125 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:53:45.011389 22125 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:53:45.012872 22125 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:33445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:33445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=43377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:53:45.013123 22125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:53:45.013368 22125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:53:45.018337 22133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:53:45.018344 22137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:53:45.018344 22135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:53:45.018553 22125 server_base.cc:1034] running on GCE node
I20260808 17:53:45.018790 22125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:53:45.019059 22125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:53:45.020210 22125 hybrid_clock.cc:648] HybridClock initialized: now 1786211625020199 us; error 30 us; skew 500 ppm
Aug 08 17:53:45 dist-test-slave-bndk krb5kdc[20545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211625, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:53:45.026302 22125 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:53:45.026783 22125 webserver.cc:460] Webserver started at http://127.28.213.190:43377/ using document root <none> and password file <none>
I20260808 17:53:45.026981 22125 fs_manager.cc:359] Metadata directory not provided
I20260808 17:53:45.027030 22125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:53:45.028432 22125 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:53:45.029152 22146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:45.029335 22125 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:53:45.029420 22125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "b86f6b7e29964e3db796fe7e7309acf2"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "42e8a256d731884bc8a5d1b1c9fb87fd"
server_key_iv: "b1585aa77e328071d239c6259db53990"
server_key_version: "encryptionkey@0"
I20260808 17:53:45.029721 22125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:53:45.040550 22125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:53:45.042615 22125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:53:45.042776 22125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:53:45.047151 22125 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:33445
I20260808 17:53:45.047179 22236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:33445 every 8 connection(s)
I20260808 17:53:45.047561 22125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:53:45.049113 22237 sys_catalog.cc:263] Verifying existing consensus state
I20260808 17:53:45.049777 22237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: Bootstrap starting.
I20260808 17:53:45.053992 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 22125
I20260808 17:53:45.054294 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:38137
--local_ip_for_outbound_sockets=127.28.213.129
--tserver_master_addrs=127.28.213.190:33445
--webserver_port=44231
--webserver_interface=127.28.213.129
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:53:45.058792 22237 log.cc:824] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: Log is configured to *not* fsync() on all Append() calls
I20260808 17:53:45.061105 22237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:53:45.061393 22237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: Bootstrap complete.
I20260808 17:53:45.063323 22237 raft_consensus.cc:348] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86f6b7e29964e3db796fe7e7309acf2" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33445 } }
I20260808 17:53:45.063539 22237 raft_consensus.cc:729] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b86f6b7e29964e3db796fe7e7309acf2, State: Initialized, Role: FOLLOWER
I20260808 17:53:45.063681 22237 consensus_queue.cc:260] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86f6b7e29964e3db796fe7e7309acf2" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33445 } }
I20260808 17:53:45.063735 22237 raft_consensus.cc:388] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:53:45.063781 22237 raft_consensus.cc:482] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:53:45.063827 22237 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 2 FOLLOWER]: Advancing to term 3
I20260808 17:53:45.064719 22237 raft_consensus.cc:504] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86f6b7e29964e3db796fe7e7309acf2" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33445 } }
I20260808 17:53:45.064811 22237 leader_election.cc:302] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b86f6b7e29964e3db796fe7e7309acf2; no voters:
I20260808 17:53:45.064965 22237 leader_election.cc:288] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 17:53:45.065006 22242 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 17:53:45.065171 22242 raft_consensus.cc:686] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [term 3 LEADER]: Becoming Leader. State: Replica: b86f6b7e29964e3db796fe7e7309acf2, State: Running, Role: LEADER
I20260808 17:53:45.065212 22237 sys_catalog.cc:564] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:53:45.065286 22242 consensus_queue.cc:237] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86f6b7e29964e3db796fe7e7309acf2" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33445 } }
I20260808 17:53:45.065557 22243 sys_catalog.cc:455] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "b86f6b7e29964e3db796fe7e7309acf2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86f6b7e29964e3db796fe7e7309acf2" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33445 } } }
I20260808 17:53:45.065560 22242 sys_catalog.cc:455] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b86f6b7e29964e3db796fe7e7309acf2. Latest consensus state: current_term: 3 leader_uuid: "b86f6b7e29964e3db796fe7e7309acf2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86f6b7e29964e3db796fe7e7309acf2" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 33445 } } }
I20260808 17:53:45.065644 22243 sys_catalog.cc:458] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [sys.catalog]: This master's current role is: LEADER
I20260808 17:53:45.065656 22242 sys_catalog.cc:458] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2 [sys.catalog]: This master's current role is: LEADER
I20260808 17:53:45.065981 22248 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:53:45.067262 22248 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:53:45.067363 22248 catalog_manager.cc:1259] Loaded cluster ID: 847c4444efd34a4aaa9c7cf63ab87073
I20260808 17:53:45.067390 22248 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:53:45.068192 22248 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:53:45.068331 22248 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: Loaded TSK: 0
I20260808 17:53:45.068364 22248 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b86f6b7e29964e3db796fe7e7309acf2: Loaded TSK: 1
F20260808 17:53:45.068527 22248 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fc870f089ad google::LogMessage::Fail() at ??:0
@ 0x7fc870f0b88a google::LogMessage::SendToLog() at ??:0
@ 0x7fc870f084de google::LogMessage::Flush() at ??:0
@ 0x7fc870f09a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc873675104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fc873672d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fc878e661cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fc878e6648e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fc878e66594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fc878e2cc48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fc878e36ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fc872dd60d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc872dcb954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc873c2f6db start_thread at ??:0
@ 0x7fc86fa0661f clone at ??:0
W20260808 17:53:45.148211 22239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:53:45.148394 22239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:53:45.148423 22239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:53:45.149564 22239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:53:45.149603 22239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:53:45.149636 22239 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:53:45.151031 22239 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:38137
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=44231
--tserver_master_addrs=127.28.213.190:33445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:53:45.151244 22239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:53:45.151458 22239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:53:45.156189 22298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:53:45.156265 22239 server_base.cc:1034] running on GCE node
W20260808 17:53:45.156176 22299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:53:45.156394 22302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:53:45.156580 22239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:53:45.156788 22239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:53:45.157953 22239 hybrid_clock.cc:648] HybridClock initialized: now 1786211625157935 us; error 35 us; skew 500 ppm
Aug 08 17:53:45 dist-test-slave-bndk krb5kdc[20545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211625, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:53:45.160368 22239 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:53:45.160773 22239 webserver.cc:460] Webserver started at http://127.28.213.129:44231/ using document root <none> and password file <none>
I20260808 17:53:45.160969 22239 fs_manager.cc:359] Metadata directory not provided
I20260808 17:53:45.161062 22239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:53:45.162552 22239 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:53:45.163216 22312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:45.163379 22239 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:53:45.163457 22239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "3e291269c53349a6bf5de610c79be95e"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "cba06e77fc8ac9b9d53cad35b9c76f20"
server_key_iv: "642d16ab6f9fd1504becd26e1881de03"
server_key_version: "encryptionkey@0"
I20260808 17:53:45.163753 22239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:53:45.175251 22239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:53:45.177917 22239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:53:45.178103 22239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:53:45.178428 22239 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:53:45.181012 22327 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 17:53:45.183076 22239 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 17:53:45.183144 22239 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 17:53:45.183182 22239 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 17:53:45.184023 22239 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 17:53:45.184063 22239 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 17:53:45.184254 22327 tablet_bootstrap.cc:492] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e: Bootstrap starting.
I20260808 17:53:45.195533 22327 log.cc:824] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e: Log is configured to *not* fsync() on all Append() calls
I20260808 17:53:45.196998 22239 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:38137
I20260808 17:53:45.197431 22239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:53:45.198510 22327 tablet_bootstrap.cc:492] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 17:53:45.198793 22487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:38137 every 8 connection(s)
I20260808 17:53:45.199076 22327 tablet_bootstrap.cc:492] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e: Bootstrap complete.
I20260808 17:53:45.200143 22327 ts_tablet_manager.cc:1397] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.009s
I20260808 17:53:45.201462 22327 raft_consensus.cc:348] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:45.201783 22327 raft_consensus.cc:729] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e291269c53349a6bf5de610c79be95e, State: Initialized, Role: FOLLOWER
I20260808 17:53:45.201934 22327 consensus_queue.cc:260] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:45.202251 22327 ts_tablet_manager.cc:1428] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:53:45.202383 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 22239
I20260808 17:53:45.202706 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:39925
--local_ip_for_outbound_sockets=127.28.213.130
--tserver_master_addrs=127.28.213.190:33445
--webserver_port=45439
--webserver_interface=127.28.213.130
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:53:45.282948 22492 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:53:45.198072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:41207)
0808 17:53:45.198228 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:45.198272 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 17:53:45.198817 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:53:45.282786 (+ 83969us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":81,"threads_started":1}
W20260808 17:53:45.283209 22488 heartbeater.cc:644] Failed to heartbeat to 127.28.213.190:33445 (0 consecutive failures): Network error: Failed to ping master at 127.28.213.190:33445: Client connection negotiation failed: client connection to 127.28.213.190:33445: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 17:53:45.283528 22492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:45.283425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:45439)
0808 17:53:45.283471 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:45.283508 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 17:53:45.283864 22492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:45.283782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:60909)
0808 17:53:45.283824 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:45.283848 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 17:53:45.283977 22488 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 17:53:45.299772 22494 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:53:45.299966 22494 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:53:45.299988 22494 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:53:45.301074 22494 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:53:45.301108 22494 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:53:45.301131 22494 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:53:45.302623 22494 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:39925
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=45439
--tserver_master_addrs=127.28.213.190:33445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22494
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:53:45.302815 22494 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:53:45.302984 22494 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:53:45.307610 22505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:53:45.307622 22503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:53:45.307739 22494 server_base.cc:1034] running on GCE node
W20260808 17:53:45.307605 22502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:53:45.308013 22494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:53:45.308197 22494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:53:45.309316 22494 hybrid_clock.cc:648] HybridClock initialized: now 1786211625309300 us; error 30 us; skew 500 ppm
Aug 08 17:53:45 dist-test-slave-bndk krb5kdc[20545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211625, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:53:45.311735 22494 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:53:45.312140 22494 webserver.cc:460] Webserver started at http://127.28.213.130:45439/ using document root <none> and password file <none>
I20260808 17:53:45.312330 22494 fs_manager.cc:359] Metadata directory not provided
I20260808 17:53:45.312377 22494 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:53:45.313699 22494 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:53:45.314349 22517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:45.314512 22494 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:53:45.314591 22494 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "bae22e4227924bac9ab9270d2e1a770b"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "fdf14a5c3cfe80187d75f6899bdb3a37"
server_key_iv: "5136439861df97c4d9034bc760085ab5"
server_key_version: "encryptionkey@0"
I20260808 17:53:45.314893 22494 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:53:45.327656 22494 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:53:45.329320 22494 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:53:45.329447 22494 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:53:45.329633 22494 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:53:45.329923 22494 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:53:45.329957 22494 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:45.329983 22494 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:53:45.330000 22494 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:45.336187 22494 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:39925
I20260808 17:53:45.336244 22677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:39925 every 8 connection(s)
I20260808 17:53:45.336547 22494 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:53:45.337469 22680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:45.337127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:59509)
0808 17:53:45.337271 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:45.337334 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":98,"threads_started":1}
W20260808 17:53:45.337797 22678 heartbeater.cc:644] Failed to heartbeat to 127.28.213.190:33445 (0 consecutive failures): Network error: Failed to ping master at 127.28.213.190:33445: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
I20260808 17:53:45.338025 22680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:45.337948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:51341)
0808 17:53:45.337985 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:45.338010 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 17:53:45.338225 22680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:45.338168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:48675)
0808 17:53:45.338195 (+ 27us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:45.338213 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260808 17:53:45.338294 22678 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 17:53:45.338934 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 22494
I20260808 17:53:45.339243 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:45215
--local_ip_for_outbound_sockets=127.28.213.131
--tserver_master_addrs=127.28.213.190:33445
--webserver_port=37611
--webserver_interface=127.28.213.131
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:53:45.419625 22681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:53:45.419816 22681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:53:45.419847 22681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:53:45.420940 22681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:53:45.420980 22681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:53:45.421012 22681 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:53:45.422467 22681 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:45215
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=37611
--tserver_master_addrs=127.28.213.190:33445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22681
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:53:45.422696 22681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:53:45.422896 22681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:53:45.427547 22687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:53:45.427605 22681 server_base.cc:1034] running on GCE node
W20260808 17:53:45.427537 22688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:53:45.427527 22690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:53:45.427978 22681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:53:45.428186 22681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:53:45.429304 22681 hybrid_clock.cc:648] HybridClock initialized: now 1786211625429287 us; error 30 us; skew 500 ppm
Aug 08 17:53:45 dist-test-slave-bndk krb5kdc[20545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211625, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:53:45.431587 22681 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:53:45.431996 22681 webserver.cc:460] Webserver started at http://127.28.213.131:37611/ using document root <none> and password file <none>
I20260808 17:53:45.432183 22681 fs_manager.cc:359] Metadata directory not provided
I20260808 17:53:45.432225 22681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:53:45.433493 22681 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:53:45.434055 22699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:45.434193 22681 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:53:45.434273 22681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "a5285b2695464e61a3a17ddc6f1b3aa3"
format_stamp: "Formatted at 2026-08-08 17:53:03 on dist-test-slave-bndk"
server_key: "c071bc4cc75143fde7c41b0047260f1b"
server_key_iv: "c0b3df5c83c5dca813bbd8cfaff01c7c"
server_key_version: "encryptionkey@0"
I20260808 17:53:45.434566 22681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:53:45.453822 22681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:53:45.455819 22681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:53:45.455955 22681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:53:45.456142 22681 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:53:45.456489 22681 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:53:45.456525 22681 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:45.456552 22681 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:53:45.456569 22681 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:53:45.462860 22681 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:45215
I20260808 17:53:45.462926 22870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:45215 every 8 connection(s)
I20260808 17:53:45.463212 22681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:53:45.464099 22874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:45.463761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:53769)
0808 17:53:45.463898 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:45.463967 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":72,"threads_started":1}
I20260808 17:53:45.464242 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 22681
W20260808 17:53:45.464480 22872 heartbeater.cc:644] Failed to heartbeat to 127.28.213.190:33445 (0 consecutive failures): Network error: Failed to ping master at 127.28.213.190:33445: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
I20260808 17:53:45.464772 22874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:45.464685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:59973)
0808 17:53:45.464720 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:45.464746 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260808 17:53:45.465008 22874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:45.464958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:33347)
0808 17:53:45.464979 (+ 21us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:45.464995 (+ 16us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
W20260808 17:53:45.465090 22872 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 17:53:46.284513 22876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:46.284303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:42121)
0808 17:53:46.284414 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:46.284448 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":61,"threads_started":1}
I20260808 17:53:46.338768 22877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:46.338582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:55885)
0808 17:53:46.338690 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:46.338722 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":56,"threads_started":1}
I20260808 17:53:46.465564 22878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:46.465380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:41691)
0808 17:53:46.465482 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:46.465514 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":57,"threads_started":1}
I20260808 17:53:46.943967 22879 raft_consensus.cc:482] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:53:46.944094 22879 raft_consensus.cc:504] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:46.944382 22879 leader_election.cc:288] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a5285b2695464e61a3a17ddc6f1b3aa3 (127.28.213.131:45215), bae22e4227924bac9ab9270d2e1a770b (127.28.213.130:39925)
Aug 08 17:53:46 dist-test-slave-bndk krb5kdc[20545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211625, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.130@KRBTEST.COM
Aug 08 17:53:46 dist-test-slave-bndk krb5kdc[20545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211625, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.131@KRBTEST.COM
I20260808 17:53:46.954134 22882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:46.944564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:39925 (local address 127.28.213.129:39591)
0808 17:53:46.944683 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:46.944694 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:53:46.944750 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:53:46.945570 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:53:46.945573 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:53:46.945981 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:53:46.946175 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:46.946181 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:46.947248 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:46.947250 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:46.948005 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:46.948007 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:46.948594 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:46.948595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:46.948722 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:46.949191 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:53:46.949200 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:53:46.950842 (+ 1642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:53:46.952621 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:53:46.952629 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:53:46.952631 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:53:46.952896 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:53:46.953155 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:53:46.953156 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:53:46.953156 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:53:46.953317 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:53:46.953669 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:53:46.953675 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:53:46.953823 (+ 148us) client_negotiation.cc:769] Sending connection context
0808 17:53:46.953925 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 17:53:46.954054 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":97,"threads_started":1}
I20260808 17:53:46.954224 22885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:46.944651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:39591 (local address 127.28.213.130:39925)
0808 17:53:46.944801 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:46.944814 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:46.944840 (+ 26us) server_negotiation.cc:407] Connection header received
0808 17:53:46.945335 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:46.945337 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:46.945382 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:46.945517 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:53:46.946294 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:46.947155 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:46.948089 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:46.948511 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:46.948620 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:46.950951 (+ 2331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:53:46.950955 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:53:46.950955 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:53:46.950966 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:53:46.952508 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:46.952985 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:46.952989 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:46.952989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:46.953091 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:46.953378 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:46.953379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:46.953379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:46.953603 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:53:46.953664 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:46.953989 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 17:53:46.954119 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":52,"threads_started":1}
W20260808 17:53:46.955114 22313 leader_election.cc:341] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bae22e4227924bac9ab9270d2e1a770b (127.28.213.130:39925): Not found: Tablet not found: 864b7d4d60fc4ff7b5ed979488ce62cc
I20260808 17:53:46.955346 22883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:46.944583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:45215 (local address 127.28.213.129:41063)
0808 17:53:46.944714 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:46.944724 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:53:46.944778 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:53:46.945570 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:53:46.945573 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:53:46.947956 (+ 2383us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:53:46.948028 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:46.948030 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:46.949189 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:46.949190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:46.949750 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:53:46.949753 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:53:46.950333 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:53:46.950334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:53:46.950404 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:46.950762 (+ 358us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:53:46.950767 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:53:46.951939 (+ 1172us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:53:46.953887 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:53:46.953888 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:53:46.953889 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:53:46.954144 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:53:46.954560 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:53:46.954561 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:53:46.954562 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:53:46.954637 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:53:46.955030 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:53:46.955031 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:53:46.955077 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 17:53:46.955154 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 17:53:46.955246 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":46,"threads_started":1}
I20260808 17:53:46.955397 22887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:46.944701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:41063 (local address 127.28.213.131:45215)
0808 17:53:46.944860 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 17:53:46.944870 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:53:46.944896 (+ 26us) server_negotiation.cc:407] Connection header received
0808 17:53:46.945335 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:53:46.945337 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:53:46.945391 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:53:46.945517 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:53:46.948147 (+ 2630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:46.949037 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:46.949830 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:53:46.950261 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:53:46.950367 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:53:46.952034 (+ 1667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:53:46.952038 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:53:46.952038 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:53:46.952050 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:53:46.953810 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:46.954387 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:46.954390 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:46.954390 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:46.954494 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:53:46.954707 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:53:46.954708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:53:46.954708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:53:46.954953 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:53:46.955044 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 17:53:46.955197 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 17:53:46.955315 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":56,"threads_started":1}
W20260808 17:53:46.955960 22319 leader_election.cc:341] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a5285b2695464e61a3a17ddc6f1b3aa3 (127.28.213.131:45215): Not found: Tablet not found: 864b7d4d60fc4ff7b5ed979488ce62cc
I20260808 17:53:46.956027 22319 leader_election.cc:302] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e291269c53349a6bf5de610c79be95e; no voters: a5285b2695464e61a3a17ddc6f1b3aa3, bae22e4227924bac9ab9270d2e1a770b
I20260808 17:53:46.956130 22879 raft_consensus.cc:2726] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:53:47.284972 22883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:47.284859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:37487)
0808 17:53:47.284903 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:47.284932 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260808 17:53:47.339318 22889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:47.339130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:54073)
0808 17:53:47.339234 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:47.339277 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":54,"threads_started":1}
I20260808 17:53:47.466075 22890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:47.465905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:35751)
0808 17:53:47.466005 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:47.466040 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":51,"threads_started":1}
I20260808 17:53:48.285542 22891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:48.285319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:59373)
0808 17:53:48.285452 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:48.285488 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":61,"threads_started":1}
I20260808 17:53:48.339884 22894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:48.339705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:48825)
0808 17:53:48.339816 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:48.339847 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":57,"threads_started":1}
I20260808 17:53:48.466636 22896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:48.466453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:36981)
0808 17:53:48.466565 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:48.466597 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":53,"threads_started":1}
I20260808 17:53:49.048254 22897 raft_consensus.cc:482] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:53:49.048348 22897 raft_consensus.cc:504] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:49.048511 22897 leader_election.cc:288] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a5285b2695464e61a3a17ddc6f1b3aa3 (127.28.213.131:45215), bae22e4227924bac9ab9270d2e1a770b (127.28.213.130:39925)
W20260808 17:53:49.048899 22313 leader_election.cc:341] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bae22e4227924bac9ab9270d2e1a770b (127.28.213.130:39925): Not found: Tablet not found: 864b7d4d60fc4ff7b5ed979488ce62cc
W20260808 17:53:49.049005 22319 leader_election.cc:341] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a5285b2695464e61a3a17ddc6f1b3aa3 (127.28.213.131:45215): Not found: Tablet not found: 864b7d4d60fc4ff7b5ed979488ce62cc
I20260808 17:53:49.049073 22319 leader_election.cc:302] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e291269c53349a6bf5de610c79be95e; no voters: a5285b2695464e61a3a17ddc6f1b3aa3, bae22e4227924bac9ab9270d2e1a770b
I20260808 17:53:49.049151 22897 raft_consensus.cc:2726] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:53:49.286099 22901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:49.285912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:60795)
0808 17:53:49.286020 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:49.286053 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":63,"threads_started":1}
I20260808 17:53:49.340448 22903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:49.340233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:39891)
0808 17:53:49.340354 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:49.340386 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":60,"threads_started":1}
I20260808 17:53:49.467233 22904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:49.467015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:34775)
0808 17:53:49.467149 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:49.467182 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
I20260808 17:53:50.286667 22905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:50.286483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:38119)
0808 17:53:50.286591 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:50.286622 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":59,"threads_started":1}
I20260808 17:53:50.341064 22906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:50.340845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:38071)
0808 17:53:50.340966 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:50.341002 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":65,"threads_started":1}
I20260808 17:53:50.467763 22908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:50.467587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:49419)
0808 17:53:50.467695 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:50.467725 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":58,"threads_started":1}
I20260808 17:53:51.287247 22909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:51.287048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:33409)
0808 17:53:51.287164 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:51.287200 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":62,"threads_started":1}
I20260808 17:53:51.341679 22910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:51.341497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:50981)
0808 17:53:51.341609 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:51.341639 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":61,"threads_started":1}
I20260808 17:53:51.468308 22911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:51.468129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:48055)
0808 17:53:51.468238 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:51.468270 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":60,"threads_started":1}
I20260808 17:53:51.913419 22917 raft_consensus.cc:482] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:53:51.913507 22917 raft_consensus.cc:504] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:51.913668 22917 leader_election.cc:288] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a5285b2695464e61a3a17ddc6f1b3aa3 (127.28.213.131:45215), bae22e4227924bac9ab9270d2e1a770b (127.28.213.130:39925)
W20260808 17:53:51.914040 22319 leader_election.cc:341] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a5285b2695464e61a3a17ddc6f1b3aa3 (127.28.213.131:45215): Not found: Tablet not found: 864b7d4d60fc4ff7b5ed979488ce62cc
W20260808 17:53:51.914125 22313 leader_election.cc:341] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bae22e4227924bac9ab9270d2e1a770b (127.28.213.130:39925): Not found: Tablet not found: 864b7d4d60fc4ff7b5ed979488ce62cc
I20260808 17:53:51.914183 22313 leader_election.cc:302] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e291269c53349a6bf5de610c79be95e; no voters: a5285b2695464e61a3a17ddc6f1b3aa3, bae22e4227924bac9ab9270d2e1a770b
I20260808 17:53:51.914265 22917 raft_consensus.cc:2726] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:53:52.287818 22920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:52.287598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:53245)
0808 17:53:52.287737 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:52.287772 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":85,"threads_started":1}
I20260808 17:53:52.342274 22921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:52.342070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:57713)
0808 17:53:52.342192 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:52.342221 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":73,"threads_started":1}
I20260808 17:53:52.468860 22922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:52.468684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:50687)
0808 17:53:52.468790 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:52.468821 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":57,"threads_started":1}
I20260808 17:53:53.288419 22923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:53.288220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:40791)
0808 17:53:53.288340 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:53.288372 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":60,"threads_started":1}
I20260808 17:53:53.342880 22924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:53.342671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:60743)
0808 17:53:53.342792 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:53.342828 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":57,"threads_started":1}
I20260808 17:53:53.469485 22927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:53.469280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:35641)
0808 17:53:53.469411 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:53.469446 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":59,"threads_started":1}
I20260808 17:53:54.289078 22928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:54.288855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:49409)
0808 17:53:54.288994 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:54.289029 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":75,"threads_started":1}
I20260808 17:53:54.343466 22929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:54.343275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:49133)
0808 17:53:54.343394 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:54.343427 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":60,"threads_started":1}
I20260808 17:53:54.470039 22930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:54.469848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:56573)
0808 17:53:54.469962 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:54.469998 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":62,"threads_started":1}
I20260808 17:53:55.291913 22932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:55.290532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:34377)
0808 17:53:55.291824 (+ 1292us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:55.291862 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1272,"thread_start_us":1236,"threads_started":1}
I20260808 17:53:55.344070 22933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:55.343874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:36517)
0808 17:53:55.343997 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:55.344030 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":77,"threads_started":1}
I20260808 17:53:55.470641 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:55.470450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:57431)
0808 17:53:55.470569 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:55.470601 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":60,"threads_started":1}
I20260808 17:53:56.292491 22936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:56.292281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:56443)
0808 17:53:56.292411 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:56.292446 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":70,"threads_started":1}
I20260808 17:53:56.344590 22937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:56.344409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:46241)
0808 17:53:56.344519 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:56.344551 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":60,"threads_started":1}
I20260808 17:53:56.471256 22938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:56.471068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:46719)
0808 17:53:56.471179 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:56.471214 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":60,"threads_started":1}
I20260808 17:53:56.966856 22940 raft_consensus.cc:482] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:53:56.966984 22940 raft_consensus.cc:504] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5285b2695464e61a3a17ddc6f1b3aa3" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 45215 } } peers { permanent_uuid: "bae22e4227924bac9ab9270d2e1a770b" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 39925 } } peers { permanent_uuid: "3e291269c53349a6bf5de610c79be95e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38137 } }
I20260808 17:53:56.967154 22940 leader_election.cc:288] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a5285b2695464e61a3a17ddc6f1b3aa3 (127.28.213.131:45215), bae22e4227924bac9ab9270d2e1a770b (127.28.213.130:39925)
W20260808 17:53:56.967502 22313 leader_election.cc:341] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bae22e4227924bac9ab9270d2e1a770b (127.28.213.130:39925): Not found: Tablet not found: 864b7d4d60fc4ff7b5ed979488ce62cc
W20260808 17:53:56.967571 22319 leader_election.cc:341] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a5285b2695464e61a3a17ddc6f1b3aa3 (127.28.213.131:45215): Not found: Tablet not found: 864b7d4d60fc4ff7b5ed979488ce62cc
I20260808 17:53:56.967640 22319 leader_election.cc:302] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e291269c53349a6bf5de610c79be95e; no voters: a5285b2695464e61a3a17ddc6f1b3aa3, bae22e4227924bac9ab9270d2e1a770b
I20260808 17:53:56.967713 22940 raft_consensus.cc:2726] T 864b7d4d60fc4ff7b5ed979488ce62cc P 3e291269c53349a6bf5de610c79be95e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 17:53:57.293083 22941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:57.292861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:36497)
0808 17:53:57.293004 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:57.293034 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":74,"threads_started":1}
I20260808 17:53:57.345160 22942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:57.344980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:39695)
0808 17:53:57.345086 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:57.345120 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":57,"threads_started":1}
I20260808 17:53:57.471819 22943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:57.471643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:37721)
0808 17:53:57.471745 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:57.471779 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":56,"threads_started":1}
I20260808 17:53:58.293677 22944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:58.293480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:50273)
0808 17:53:58.293596 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:58.293630 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":60,"threads_started":1}
I20260808 17:53:58.345721 22946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:58.345538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:38681)
0808 17:53:58.345648 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:58.345681 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":57,"threads_started":1}
I20260808 17:53:58.472379 22947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:58.472188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:44979)
0808 17:53:58.472310 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:58.472338 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":75,"threads_started":1}
I20260808 17:53:59.294224 22948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:59.294015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:47965)
0808 17:53:59.294142 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:59.294177 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":63,"threads_started":1}
I20260808 17:53:59.346307 22949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:59.346123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:34303)
0808 17:53:59.346230 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:59.346264 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":61,"threads_started":1}
I20260808 17:53:59.472958 22950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:53:59.472767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:49157)
0808 17:53:59.472882 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 17:53:59.472916 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":56,"threads_started":1}
I20260808 17:54:00.294855 22952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:00.294648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.129:58657)
0808 17:54:00.294772 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:00.294809 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":58,"threads_started":1}
I20260808 17:54:00.346941 22954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:00.346738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.130:44223)
0808 17:54:00.346865 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:00.346898 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":56,"threads_started":1}
I20260808 17:54:00.466456 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 22239
I20260808 17:54:00.473554 22955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:00.473383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:33445 (local address 127.28.213.131:50107)
0808 17:54:00.473486 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:00.473514 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.190:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":51,"threads_started":1}
I20260808 17:54:00.477562 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 22494
I20260808 17:54:00.488911 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 22681
2026-08-08T17:54:00Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58670 ms)
[----------] 30 tests from SecurityITest (229313 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:00 dist-test-slave-bndk krb5kdc[22959](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:00 dist-test-slave-bndk krb5kdc[22959](info): set up 2 sockets
Aug 08 17:54:00 dist-test-slave-bndk krb5kdc[22959](info): commencing operation
krb5kdc: starting...
W20260808 17:54:01.658375 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:01 dist-test-slave-bndk krb5kdc[22959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:54:01.771797 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:39073
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:36079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:39073
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:01.850826 22976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:01.851022 22976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:01.851050 22976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:01.852155 22976 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:01.852196 22976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:01.852214 22976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:01.852229 22976 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:01.852245 22976 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:01.853721 22976 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:36079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:39073
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:39073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:01.853951 22976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:01.854156 22976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:01.858624 22984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:01.858793 22976 server_base.cc:1034] running on GCE node
W20260808 17:54:01.858636 22986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:01.858636 22983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:01.859201 22976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:01.859484 22976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:01.860630 22976 hybrid_clock.cc:648] HybridClock initialized: now 1786211641860617 us; error 25 us; skew 500 ppm
Aug 08 17:54:01 dist-test-slave-bndk krb5kdc[22959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211641, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:01.862941 22976 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:54:01.863364 22976 webserver.cc:460] Webserver started at http://127.28.213.190:39699/ using document root <none> and password file <none>
I20260808 17:54:01.863577 22976 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:01.863626 22976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:01.863754 22976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:01.864759 22976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "4fb257e0c5b7424faef22541140eff54"
format_stamp: "Formatted at 2026-08-08 17:54:01 on dist-test-slave-bndk"
server_key: "f56bdff126375ecf3cdda94345a5952b"
server_key_iv: "6c33c2069afc9a643bf36c472eafeb2f"
server_key_version: "encryptionkey@0"
I20260808 17:54:01.865087 22976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "4fb257e0c5b7424faef22541140eff54"
format_stamp: "Formatted at 2026-08-08 17:54:01 on dist-test-slave-bndk"
server_key: "f56bdff126375ecf3cdda94345a5952b"
server_key_iv: "6c33c2069afc9a643bf36c472eafeb2f"
server_key_version: "encryptionkey@0"
I20260808 17:54:01.866551 22976 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:54:01.867185 22993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:01.867336 22976 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:54:01.867426 22976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "4fb257e0c5b7424faef22541140eff54"
format_stamp: "Formatted at 2026-08-08 17:54:01 on dist-test-slave-bndk"
server_key: "f56bdff126375ecf3cdda94345a5952b"
server_key_iv: "6c33c2069afc9a643bf36c472eafeb2f"
server_key_version: "encryptionkey@0"
I20260808 17:54:01.867486 22976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:01.882890 22976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:01.884591 22976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:01.884717 22976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:01.888605 22976 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:39073
I20260808 17:54:01.888638 23069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:39073 every 8 connection(s)
I20260808 17:54:01.888933 22976 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:01.889770 23070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:01.891985 23070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54: Bootstrap starting.
I20260808 17:54:01.892524 23070 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:01.892787 23070 log.cc:824] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:01.893523 23070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54: No bootstrap required, opened a new log
I20260808 17:54:01.895175 23070 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fb257e0c5b7424faef22541140eff54" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39073 } }
I20260808 17:54:01.895315 23070 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:01.895351 23070 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fb257e0c5b7424faef22541140eff54, State: Initialized, Role: FOLLOWER
I20260808 17:54:01.895493 23070 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fb257e0c5b7424faef22541140eff54" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39073 } }
I20260808 17:54:01.895571 23070 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:01.895610 23070 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:01.895656 23070 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:01.895756 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 22976
I20260808 17:54:01.895864 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:01.896034 29526 external_mini_cluster.cc:1428] Setting key df41f5db0c1d74e516f783696f8fbf01
I20260808 17:54:01.896309 23070 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fb257e0c5b7424faef22541140eff54" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39073 } }
I20260808 17:54:01.896430 23070 leader_election.cc:302] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4fb257e0c5b7424faef22541140eff54; no voters:
I20260808 17:54:01.896592 23070 leader_election.cc:288] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:01.896824 23078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:01.896911 23070 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:01.896989 23078 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54 [term 1 LEADER]: Becoming Leader. State: Replica: 4fb257e0c5b7424faef22541140eff54, State: Running, Role: LEADER
I20260808 17:54:01.897126 23078 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fb257e0c5b7424faef22541140eff54" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39073 } }
I20260808 17:54:01.897480 23078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4fb257e0c5b7424faef22541140eff54. Latest consensus state: current_term: 1 leader_uuid: "4fb257e0c5b7424faef22541140eff54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fb257e0c5b7424faef22541140eff54" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39073 } } }
I20260808 17:54:01.897615 23079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4fb257e0c5b7424faef22541140eff54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fb257e0c5b7424faef22541140eff54" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39073 } } }
I20260808 17:54:01.897622 23078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:01.897715 23079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:01.898000 23090 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:01.898696 23090 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:01.900194 23090 catalog_manager.cc:1347] Generated new cluster ID: b124c85ffc404641914b26df717422b9
I20260808 17:54:01.900249 23090 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:54:01 dist-test-slave-bndk krb5kdc[22959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:01.906538 23077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:01.896529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33870 (local address 127.28.213.190:39073)
0808 17:54:01.896687 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:01.896697 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:01.896733 (+ 36us) server_negotiation.cc:407] Connection header received
0808 17:54:01.896867 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:01.896874 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:01.896927 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:01.897882 (+ 955us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:01.898005 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:01.899532 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:01.900412 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:01.900818 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:01.900915 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:01.903172 (+ 2257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:01.903176 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:01.903176 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:01.903188 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:01.904645 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:01.904962 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:01.904965 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:01.904965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:01.905559 (+ 594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:01.905750 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:01.905750 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:01.905751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:01.905988 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:01.906148 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:01.906213 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 17:54:01.906345 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":77,"threads_started":1}
I20260808 17:54:01.909654 23090 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:01.910336 23090 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:01.919231 23090 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54: Generated new TSK 0
I20260808 17:54:01.919389 23090 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
I20260808 17:54:01.946077 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:39073
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:36079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:02.025722 23108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:02.025911 23108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:02.025934 23108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:02.027036 23108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:02.027078 23108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:02.027107 23108 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:54:02.028573 23108 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:36079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:39073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:02.028782 23108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:02.028995 23108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:02.033598 23117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:02.033715 23108 server_base.cc:1034] running on GCE node
W20260808 17:54:02.033605 23115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:02.033624 23119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:02.034010 23108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:02.034229 23108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:02.035379 23108 hybrid_clock.cc:648] HybridClock initialized: now 1786211642035365 us; error 31 us; skew 500 ppm
Aug 08 17:54:02 dist-test-slave-bndk krb5kdc[22959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211642, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:02.037767 23108 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:54:02.038152 23108 webserver.cc:460] Webserver started at http://127.28.213.129:33045/ using document root <none> and password file <none>
I20260808 17:54:02.038352 23108 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:02.038407 23108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:02.038533 23108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:02.039489 23108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "c2d19f52854a4cc9aad68ce2747ef4c1"
format_stamp: "Formatted at 2026-08-08 17:54:02 on dist-test-slave-bndk"
server_key: "4e304995947ea923fc1d7da38953a35a"
server_key_iv: "5d2b850d19815d835c469769b594c2ea"
server_key_version: "encryptionkey@0"
I20260808 17:54:02.039804 23108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "c2d19f52854a4cc9aad68ce2747ef4c1"
format_stamp: "Formatted at 2026-08-08 17:54:02 on dist-test-slave-bndk"
server_key: "4e304995947ea923fc1d7da38953a35a"
server_key_iv: "5d2b850d19815d835c469769b594c2ea"
server_key_version: "encryptionkey@0"
I20260808 17:54:02.041087 23108 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:54:02.041778 23128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:02.041917 23108 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:02.041998 23108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "c2d19f52854a4cc9aad68ce2747ef4c1"
format_stamp: "Formatted at 2026-08-08 17:54:02 on dist-test-slave-bndk"
server_key: "4e304995947ea923fc1d7da38953a35a"
server_key_iv: "5d2b850d19815d835c469769b594c2ea"
server_key_version: "encryptionkey@0"
I20260808 17:54:02.042062 23108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:02.052810 23108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:02.054464 23108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:02.054585 23108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:02.054813 23108 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:54:02.055090 23108 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:54:02.055123 23108 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:02.055151 23108 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:54:02.055168 23108 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:02.060467 23108 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:43165
I20260808 17:54:02.060504 23285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:43165 every 8 connection(s)
I20260808 17:54:02.060771 23108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
Aug 08 17:54:02 dist-test-slave-bndk krb5kdc[22959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211642, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:02.069043 23077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.061431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:36397 (local address 127.28.213.190:39073)
0808 17:54:02.061481 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:02.061483 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:02.061657 (+ 174us) server_negotiation.cc:407] Connection header received
0808 17:54:02.062115 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:02.062117 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:02.062132 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:02.062183 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:02.063135 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.063626 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.064570 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.064773 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.064829 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.066710 (+ 1881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:02.066712 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:02.066712 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:02.066719 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:02.067801 (+ 1082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:02.068151 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:02.068153 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:02.068153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:02.068209 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:02.068425 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:02.068426 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:02.068427 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:02.068536 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:02.068592 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:02.068836 (+ 244us) server_negotiation.cc:299] Negotiation successful
0808 17:54:02.068948 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:54:02.069147 23288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.061393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:39073 (local address 127.28.213.129:36397)
0808 17:54:02.061547 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:02.061583 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:02.062020 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:02.062248 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:02.062253 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:02.062853 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:02.063034 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.063039 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.063706 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.063708 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.064484 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.064487 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.064846 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.064847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.064965 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.065377 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:02.065394 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:02.066619 (+ 1225us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:02.067872 (+ 1253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:02.067879 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:02.067881 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:02.068084 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:02.068265 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:02.068266 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:02.068266 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:02.068361 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:02.068592 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:02.068599 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:02.068721 (+ 122us) client_negotiation.cc:769] Sending connection context
0808 17:54:02.068805 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 17:54:02.068948 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":77,"threads_started":1}
I20260808 17:54:02.069618 23286 heartbeater.cc:347] Connected to a master server at 127.28.213.190:39073
I20260808 17:54:02.069702 23286 heartbeater.cc:464] Registering TS with master...
I20260808 17:54:02.069859 23286 heartbeater.cc:511] Master 127.28.213.190:39073 requested a full tablet report, sending...
I20260808 17:54:02.070374 23024 ts_manager.cc:194] Registered new tserver with Master: c2d19f52854a4cc9aad68ce2747ef4c1 (127.28.213.129:43165)
I20260808 17:54:02.070441 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 23108
I20260808 17:54:02.070549 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:54:02.070755 29526 external_mini_cluster.cc:1428] Setting key 641a63bfbe548309d6375789a3798970
I20260808 17:54:02.071321 23024 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:36397
WARNING: no policy specified for kudu/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
I20260808 17:54:02.093922 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:39073
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:36079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:02.172801 23291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:02.172986 23291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:02.173015 23291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:02.174136 23291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:02.174180 23291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:02.174213 23291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:54:02.175585 23291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:36079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:39073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:02.175808 23291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:02.176004 23291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:02.180526 23305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:02.180523 23300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:02.180553 23301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:02.180637 23291 server_base.cc:1034] running on GCE node
I20260808 17:54:02.180950 23291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:02.181135 23291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:02.182260 23291 hybrid_clock.cc:648] HybridClock initialized: now 1786211642182254 us; error 39 us; skew 500 ppm
Aug 08 17:54:02 dist-test-slave-bndk krb5kdc[22959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211642, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:02.184491 23291 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:54:02.184863 23291 webserver.cc:460] Webserver started at http://127.28.213.130:39739/ using document root <none> and password file <none>
I20260808 17:54:02.185077 23291 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:02.185120 23291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:02.185266 23291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:02.186364 23291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "321cb760c06a4335b282897a205ad779"
format_stamp: "Formatted at 2026-08-08 17:54:02 on dist-test-slave-bndk"
server_key: "dfff19b4ec32776a186a2687555f780c"
server_key_iv: "188c56168dbfee5374316fd626e7127d"
server_key_version: "encryptionkey@0"
I20260808 17:54:02.186770 23291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "321cb760c06a4335b282897a205ad779"
format_stamp: "Formatted at 2026-08-08 17:54:02 on dist-test-slave-bndk"
server_key: "dfff19b4ec32776a186a2687555f780c"
server_key_iv: "188c56168dbfee5374316fd626e7127d"
server_key_version: "encryptionkey@0"
I20260808 17:54:02.188411 23291 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:54:02.189194 23314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:02.189352 23291 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:02.189433 23291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "321cb760c06a4335b282897a205ad779"
format_stamp: "Formatted at 2026-08-08 17:54:02 on dist-test-slave-bndk"
server_key: "dfff19b4ec32776a186a2687555f780c"
server_key_iv: "188c56168dbfee5374316fd626e7127d"
server_key_version: "encryptionkey@0"
I20260808 17:54:02.189502 23291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:02.216394 23291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:02.218189 23291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:02.218333 23291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:02.218549 23291 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:54:02.218859 23291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:54:02.218894 23291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:02.218923 23291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:54:02.218940 23291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:02.224310 23291 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:36049
I20260808 17:54:02.224370 23477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:36049 every 8 connection(s)
I20260808 17:54:02.224642 23291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:54:02.228170 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 23291
I20260808 17:54:02.228283 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:54:02.228499 29526 external_mini_cluster.cc:1428] Setting key f5d5339ec6185d4032400cad7f755226
Aug 08 17:54:02 dist-test-slave-bndk krb5kdc[22959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211642, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:02.233492 23077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.225314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:59179 (local address 127.28.213.190:39073)
0808 17:54:02.225355 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:02.225357 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:02.225588 (+ 231us) server_negotiation.cc:407] Connection header received
0808 17:54:02.226037 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:02.226038 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:02.226049 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:02.226096 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:02.226951 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.227440 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.228593 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.228821 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.228889 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.230999 (+ 2110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:02.231001 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:02.231002 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:02.231009 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:02.232248 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:02.232606 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:02.232608 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:02.232608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:02.232664 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:02.232879 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:02.232880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:02.232881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:02.232989 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:02.233045 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:02.233313 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 17:54:02.233407 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:54:02.233639 23482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.225324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:39073 (local address 127.28.213.130:59179)
0808 17:54:02.225461 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:02.225502 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:02.225961 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:02.226150 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:02.226154 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:02.226698 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:02.226886 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.226891 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.227501 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.227502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.228494 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.228496 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.228899 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.228901 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.229037 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.229490 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:02.229500 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:02.230914 (+ 1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:02.232322 (+ 1408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:02.232329 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:02.232331 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:02.232540 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:02.232719 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:02.232720 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:02.232720 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:02.232823 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:02.233044 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:02.233050 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:02.233177 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 17:54:02.233290 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 17:54:02.233437 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":73,"threads_started":1}
I20260808 17:54:02.234037 23479 heartbeater.cc:347] Connected to a master server at 127.28.213.190:39073
I20260808 17:54:02.234122 23479 heartbeater.cc:464] Registering TS with master...
I20260808 17:54:02.234279 23479 heartbeater.cc:511] Master 127.28.213.190:39073 requested a full tablet report, sending...
I20260808 17:54:02.234643 23024 ts_manager.cc:194] Registered new tserver with Master: 321cb760c06a4335b282897a205ad779 (127.28.213.130:36049)
I20260808 17:54:02.235121 23024 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:59179
WARNING: no policy specified for kudu/127.28.213.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
I20260808 17:54:02.251595 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:39073
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:36079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:02.331620 23485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:02.331813 23485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:02.331842 23485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:02.332937 23485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:02.332978 23485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:02.333011 23485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:54:02.334444 23485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:36079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:39073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:02.334682 23485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:02.334877 23485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 17:54:02.339540 23485 server_base.cc:1034] running on GCE node
W20260808 17:54:02.339517 23490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:02.339524 23494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:02.339581 23491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:02.339963 23485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:02.340164 23485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:02.341269 23485 hybrid_clock.cc:648] HybridClock initialized: now 1786211642341255 us; error 27 us; skew 500 ppm
Aug 08 17:54:02 dist-test-slave-bndk krb5kdc[22959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211642, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:02.343499 23485 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:54:02.343880 23485 webserver.cc:460] Webserver started at http://127.28.213.131:38305/ using document root <none> and password file <none>
I20260808 17:54:02.344085 23485 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:02.344134 23485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:02.344247 23485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:02.345268 23485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "771655c3b4be4765bb8e4f7a54148775"
format_stamp: "Formatted at 2026-08-08 17:54:02 on dist-test-slave-bndk"
server_key: "c321f014cab6184b1824597b615838b5"
server_key_iv: "15eeb1d8d41673e0db500a82860f546e"
server_key_version: "encryptionkey@0"
I20260808 17:54:02.345597 23485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "771655c3b4be4765bb8e4f7a54148775"
format_stamp: "Formatted at 2026-08-08 17:54:02 on dist-test-slave-bndk"
server_key: "c321f014cab6184b1824597b615838b5"
server_key_iv: "15eeb1d8d41673e0db500a82860f546e"
server_key_version: "encryptionkey@0"
I20260808 17:54:02.346885 23485 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:54:02.347515 23501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:02.347654 23485 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:54:02.347734 23485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "771655c3b4be4765bb8e4f7a54148775"
format_stamp: "Formatted at 2026-08-08 17:54:02 on dist-test-slave-bndk"
server_key: "c321f014cab6184b1824597b615838b5"
server_key_iv: "15eeb1d8d41673e0db500a82860f546e"
server_key_version: "encryptionkey@0"
I20260808 17:54:02.347795 23485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:02.359485 23485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:02.361032 23485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:02.361159 23485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:02.361384 23485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:54:02.361660 23485 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:54:02.361693 23485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:02.361718 23485 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:54:02.361737 23485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:02.367374 23485 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:34541
I20260808 17:54:02.367411 23666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:34541 every 8 connection(s)
I20260808 17:54:02.367686 23485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
Aug 08 17:54:02 dist-test-slave-bndk krb5kdc[22959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211642, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:02.375612 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 23485
I20260808 17:54:02.375715 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:54:02.375937 29526 external_mini_cluster.cc:1428] Setting key e90bda3ee09c3261320e73514b72129f
I20260808 17:54:02.376096 23077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.368274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:32831 (local address 127.28.213.190:39073)
0808 17:54:02.368316 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:02.368318 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:02.368492 (+ 174us) server_negotiation.cc:407] Connection header received
0808 17:54:02.368964 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:02.368965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:02.368975 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:02.369029 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:02.369932 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.370475 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.371612 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.371799 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.371848 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.373745 (+ 1897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:02.373747 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:02.373747 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:02.373753 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:02.374876 (+ 1123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:02.375208 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:02.375209 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:02.375209 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:02.375257 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:02.375463 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:02.375464 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:02.375464 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:02.375573 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:02.375637 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:02.375929 (+ 292us) server_negotiation.cc:299] Negotiation successful
0808 17:54:02.376003 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:54:02.376264 23669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.368248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:39073 (local address 127.28.213.131:32831)
0808 17:54:02.368393 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:02.368432 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:02.368879 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:02.369087 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:02.369090 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:02.369663 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:02.369840 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.369844 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.370548 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.370549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.371332 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.371334 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.371855 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.371855 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.371955 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.372375 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:02.372383 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:02.373662 (+ 1279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:02.374945 (+ 1283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:02.374951 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:02.374953 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:02.375152 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:02.375319 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:02.375319 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:02.375319 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:02.375416 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:02.375635 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:02.375640 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:02.375794 (+ 154us) client_negotiation.cc:769] Sending connection context
0808 17:54:02.375905 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 17:54:02.376058 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":66,"threads_started":1}
I20260808 17:54:02.376663 23667 heartbeater.cc:347] Connected to a master server at 127.28.213.190:39073
I20260808 17:54:02.376744 23667 heartbeater.cc:464] Registering TS with master...
I20260808 17:54:02.376902 23667 heartbeater.cc:511] Master 127.28.213.190:39073 requested a full tablet report, sending...
I20260808 17:54:02.377310 23024 ts_manager.cc:194] Registered new tserver with Master: 771655c3b4be4765bb8e4f7a54148775 (127.28.213.131:34541)
I20260808 17:54:02.377671 23024 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:32831
I20260808 17:54:02.387605 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:54:02.394438 23077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.388913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33880 (local address 127.28.213.190:39073)
0808 17:54:02.388965 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:02.388967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:02.389063 (+ 96us) server_negotiation.cc:407] Connection header received
0808 17:54:02.389118 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:02.389119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:02.389129 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:02.389173 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:02.389765 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.390218 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.390898 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.391079 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.391129 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.392224 (+ 1095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:02.392226 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:02.392226 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:02.392232 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:02.393452 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:02.393741 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:02.393742 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:02.393743 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:02.393790 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:02.393957 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:02.393958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:02.393958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:02.394082 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:02.394167 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:02.394275 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 17:54:02.394346 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 17:54:02.395707 23024 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33880:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:54:02.397269 23024 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:54:02.403673 23681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.399298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:34541 (local address 127.0.0.1:39156)
0808 17:54:02.399522 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:02.399533 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:02.399586 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:02.399951 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:02.399955 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:02.399957 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:02.400033 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.400035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.401301 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.401301 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.402549 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.402552 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.403406 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.403406 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.403481 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.403491 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 17:54:02.403548 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 17:54:02.403600 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":6,"thread_start_us":45,"threads_started":1}
I20260808 17:54:02.403693 23682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.399462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39156 (local address 127.28.213.131:34541)
0808 17:54:02.399777 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:02.399782 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:02.399794 (+ 12us) server_negotiation.cc:407] Connection header received
0808 17:54:02.399828 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:02.399830 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:02.399844 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:02.399925 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:02.400126 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.401191 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.402633 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.403340 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.403407 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.403461 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:02.403578 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 17:54:02.403619 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":73,"threads_started":1}
I20260808 17:54:02.404321 23678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.399298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:43165 (local address 127.0.0.1:38512)
0808 17:54:02.399442 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:02.399476 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:02.399541 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:02.399956 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:02.399956 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:02.399957 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:02.400025 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.400027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.402168 (+ 2141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.402169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.403139 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.403142 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.404097 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.404098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.404161 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.404165 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:54:02.404221 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 17:54:02.404257 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":2,"thread_start_us":48,"threads_started":1}
I20260808 17:54:02.404470 23676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.399302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:36049 (local address 127.0.0.1:46360)
0808 17:54:02.399627 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:02.399635 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:02.399670 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:02.400183 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:02.400184 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:02.400186 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:02.400228 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.400229 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.401444 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.401445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.402550 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.402552 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.404242 (+ 1690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.404244 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.404305 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.404310 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:54:02.404357 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 17:54:02.404397 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":3,"thread_start_us":52,"threads_started":1}
I20260808 17:54:02.404575 23574 tablet_service.cc:1467] Processing CreateTablet for tablet f83fa2c18c52463c93d7c4a529b30979 (DEFAULT_TABLE table=test-table [id=e1e5170a6351419099ae12f5e95eccce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:54:02.404697 23685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.399622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38512 (local address 127.28.213.129:43165)
0808 17:54:02.399800 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:02.399804 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:02.399814 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:54:02.399849 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:02.399851 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:02.399866 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:02.399939 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:02.401327 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.402051 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.403242 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.403928 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.404001 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.404046 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:02.404572 (+ 526us) server_negotiation.cc:299] Negotiation successful
0808 17:54:02.404616 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":87,"threads_started":1}
I20260808 17:54:02.404785 23684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.399536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46360 (local address 127.28.213.130:36049)
0808 17:54:02.400041 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:02.400045 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:02.400054 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:54:02.400089 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:02.400091 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:02.400106 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:02.400186 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:02.400293 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.401357 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.403499 (+ 2142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.404164 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.404227 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.404284 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:02.404671 (+ 387us) server_negotiation.cc:299] Negotiation successful
0808 17:54:02.404712 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":94,"threads_started":1}
I20260808 17:54:02.404914 23574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f83fa2c18c52463c93d7c4a529b30979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:02.405328 23192 tablet_service.cc:1467] Processing CreateTablet for tablet f83fa2c18c52463c93d7c4a529b30979 (DEFAULT_TABLE table=test-table [id=e1e5170a6351419099ae12f5e95eccce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:54:02.405426 23388 tablet_service.cc:1467] Processing CreateTablet for tablet f83fa2c18c52463c93d7c4a529b30979 (DEFAULT_TABLE table=test-table [id=e1e5170a6351419099ae12f5e95eccce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:54:02.405582 23192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f83fa2c18c52463c93d7c4a529b30979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:02.405747 23388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f83fa2c18c52463c93d7c4a529b30979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:02.408001 23686 tablet_bootstrap.cc:492] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1: Bootstrap starting.
I20260808 17:54:02.408550 23689 tablet_bootstrap.cc:492] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775: Bootstrap starting.
I20260808 17:54:02.408669 23686 tablet_bootstrap.cc:654] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:02.409206 23689 tablet_bootstrap.cc:654] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:02.409281 23686 log.cc:824] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:02.409379 23690 tablet_bootstrap.cc:492] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779: Bootstrap starting.
I20260808 17:54:02.409739 23689 log.cc:824] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:02.409997 23690 tablet_bootstrap.cc:654] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:02.410079 23686 tablet_bootstrap.cc:492] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1: No bootstrap required, opened a new log
I20260808 17:54:02.410147 23686 ts_tablet_manager.cc:1397] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 17:54:02.410485 23690 log.cc:824] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:02.410518 23689 tablet_bootstrap.cc:492] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775: No bootstrap required, opened a new log
I20260808 17:54:02.410576 23689 ts_tablet_manager.cc:1397] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 17:54:02.412041 23686 raft_consensus.cc:348] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "771655c3b4be4765bb8e4f7a54148775" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34541 } } peers { permanent_uuid: "c2d19f52854a4cc9aad68ce2747ef4c1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 43165 } } peers { permanent_uuid: "321cb760c06a4335b282897a205ad779" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 36049 } }
I20260808 17:54:02.412226 23686 raft_consensus.cc:374] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:02.412269 23686 raft_consensus.cc:729] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d19f52854a4cc9aad68ce2747ef4c1, State: Initialized, Role: FOLLOWER
I20260808 17:54:02.412389 23686 consensus_queue.cc:260] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "771655c3b4be4765bb8e4f7a54148775" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34541 } } peers { permanent_uuid: "c2d19f52854a4cc9aad68ce2747ef4c1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 43165 } } peers { permanent_uuid: "321cb760c06a4335b282897a205ad779" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 36049 } }
I20260808 17:54:02.412412 23689 raft_consensus.cc:348] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "771655c3b4be4765bb8e4f7a54148775" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34541 } } peers { permanent_uuid: "c2d19f52854a4cc9aad68ce2747ef4c1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 43165 } } peers { permanent_uuid: "321cb760c06a4335b282897a205ad779" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 36049 } }
I20260808 17:54:02.412568 23689 raft_consensus.cc:374] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:02.412616 23689 raft_consensus.cc:729] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 771655c3b4be4765bb8e4f7a54148775, State: Initialized, Role: FOLLOWER
I20260808 17:54:02.412678 23686 ts_tablet_manager.cc:1428] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 17:54:02.412704 23286 heartbeater.cc:503] Master 127.28.213.190:39073 was elected leader, sending a full tablet report...
I20260808 17:54:02.412727 23689 consensus_queue.cc:260] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "771655c3b4be4765bb8e4f7a54148775" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34541 } } peers { permanent_uuid: "c2d19f52854a4cc9aad68ce2747ef4c1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 43165 } } peers { permanent_uuid: "321cb760c06a4335b282897a205ad779" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 36049 } }
I20260808 17:54:02.413007 23689 ts_tablet_manager.cc:1428] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 17:54:02.413034 23667 heartbeater.cc:503] Master 127.28.213.190:39073 was elected leader, sending a full tablet report...
I20260808 17:54:02.413270 23690 tablet_bootstrap.cc:492] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779: No bootstrap required, opened a new log
I20260808 17:54:02.413338 23690 ts_tablet_manager.cc:1397] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 17:54:02.414846 23690 raft_consensus.cc:348] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "771655c3b4be4765bb8e4f7a54148775" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34541 } } peers { permanent_uuid: "c2d19f52854a4cc9aad68ce2747ef4c1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 43165 } } peers { permanent_uuid: "321cb760c06a4335b282897a205ad779" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 36049 } }
I20260808 17:54:02.414970 23690 raft_consensus.cc:374] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:02.414990 23690 raft_consensus.cc:729] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 321cb760c06a4335b282897a205ad779, State: Initialized, Role: FOLLOWER
I20260808 17:54:02.415093 23690 consensus_queue.cc:260] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "771655c3b4be4765bb8e4f7a54148775" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34541 } } peers { permanent_uuid: "c2d19f52854a4cc9aad68ce2747ef4c1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 43165 } } peers { permanent_uuid: "321cb760c06a4335b282897a205ad779" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 36049 } }
I20260808 17:54:02.415320 23690 ts_tablet_manager.cc:1428] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:54:02.415370 23479 heartbeater.cc:503] Master 127.28.213.190:39073 was elected leader, sending a full tablet report...
I20260808 17:54:02.449785 23698 raft_consensus.cc:482] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:54:02.449894 23698 raft_consensus.cc:504] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "771655c3b4be4765bb8e4f7a54148775" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34541 } } peers { permanent_uuid: "c2d19f52854a4cc9aad68ce2747ef4c1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 43165 } } peers { permanent_uuid: "321cb760c06a4335b282897a205ad779" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 36049 } }
I20260808 17:54:02.450217 23698 leader_election.cc:288] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 771655c3b4be4765bb8e4f7a54148775 (127.28.213.131:34541), 321cb760c06a4335b282897a205ad779 (127.28.213.130:36049)
I20260808 17:54:02.453781 23682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.450395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:47511 (local address 127.28.213.131:34541)
0808 17:54:02.450437 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:02.450439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:02.450449 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:54:02.450497 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:02.450498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:02.450506 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:02.450559 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:02.450698 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.451435 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.452872 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.453457 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.453529 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.453537 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:02.453687 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 17:54:02.453719 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:54:02.453781 23684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.450431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:43293 (local address 127.28.213.130:36049)
0808 17:54:02.450466 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:02.450469 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:02.450549 (+ 80us) server_negotiation.cc:407] Connection header received
0808 17:54:02.450591 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:02.450592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:02.450600 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:02.450640 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:02.450757 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.451475 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.452871 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.453465 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.453530 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.453537 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:02.453687 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 17:54:02.453719 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:54:02.453814 23288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.450330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:34541 (local address 127.28.213.129:47511)
0808 17:54:02.450384 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:02.450396 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:02.450439 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:02.450572 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:02.450573 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:02.450575 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:02.450640 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.450642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.451530 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.451531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.452794 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.452797 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.453533 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.453534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.453622 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.453623 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 17:54:02.453677 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 17:54:02.453726 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":58}
I20260808 17:54:02.453819 23702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.450350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:36049 (local address 127.28.213.129:43293)
0808 17:54:02.450486 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:02.450495 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:02.450543 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:02.450651 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:02.450651 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:02.450653 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:02.450704 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.450706 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.451530 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.451531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.452795 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.452797 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.453533 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.453534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.453619 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.453623 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:54:02.453677 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 17:54:02.453725 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":69,"thread_start_us":82,"threads_started":1}
I20260808 17:54:02.454162 23605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83fa2c18c52463c93d7c4a529b30979" candidate_uuid: "c2d19f52854a4cc9aad68ce2747ef4c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "771655c3b4be4765bb8e4f7a54148775" is_pre_election: true
I20260808 17:54:02.454162 23418 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83fa2c18c52463c93d7c4a529b30979" candidate_uuid: "c2d19f52854a4cc9aad68ce2747ef4c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "321cb760c06a4335b282897a205ad779" is_pre_election: true
I20260808 17:54:02.454289 23605 raft_consensus.cc:2454] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d19f52854a4cc9aad68ce2747ef4c1 in term 0.
I20260808 17:54:02.454289 23418 raft_consensus.cc:2454] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d19f52854a4cc9aad68ce2747ef4c1 in term 0.
I20260808 17:54:02.454504 23131 leader_election.cc:302] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 321cb760c06a4335b282897a205ad779, c2d19f52854a4cc9aad68ce2747ef4c1; no voters:
I20260808 17:54:02.454609 23698 raft_consensus.cc:2781] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:54:02.454658 23698 raft_consensus.cc:482] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:54:02.454685 23698 raft_consensus.cc:3037] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:02.455279 23698 raft_consensus.cc:504] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "771655c3b4be4765bb8e4f7a54148775" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34541 } } peers { permanent_uuid: "c2d19f52854a4cc9aad68ce2747ef4c1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 43165 } } peers { permanent_uuid: "321cb760c06a4335b282897a205ad779" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 36049 } }
I20260808 17:54:02.455380 23698 leader_election.cc:288] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [CANDIDATE]: Term 1 election: Requested vote from peers 771655c3b4be4765bb8e4f7a54148775 (127.28.213.131:34541), 321cb760c06a4335b282897a205ad779 (127.28.213.130:36049)
I20260808 17:54:02.455511 23605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83fa2c18c52463c93d7c4a529b30979" candidate_uuid: "c2d19f52854a4cc9aad68ce2747ef4c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "771655c3b4be4765bb8e4f7a54148775"
I20260808 17:54:02.455529 23418 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83fa2c18c52463c93d7c4a529b30979" candidate_uuid: "c2d19f52854a4cc9aad68ce2747ef4c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "321cb760c06a4335b282897a205ad779"
I20260808 17:54:02.455579 23605 raft_consensus.cc:3037] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:02.455592 23418 raft_consensus.cc:3037] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:02.456176 23605 raft_consensus.cc:2454] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d19f52854a4cc9aad68ce2747ef4c1 in term 1.
I20260808 17:54:02.456259 23418 raft_consensus.cc:2454] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d19f52854a4cc9aad68ce2747ef4c1 in term 1.
I20260808 17:54:02.456336 23129 leader_election.cc:302] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 771655c3b4be4765bb8e4f7a54148775, c2d19f52854a4cc9aad68ce2747ef4c1; no voters:
I20260808 17:54:02.456456 23698 raft_consensus.cc:2781] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:02.456604 23698 raft_consensus.cc:686] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [term 1 LEADER]: Becoming Leader. State: Replica: c2d19f52854a4cc9aad68ce2747ef4c1, State: Running, Role: LEADER
I20260808 17:54:02.456679 23698 consensus_queue.cc:237] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "771655c3b4be4765bb8e4f7a54148775" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34541 } } peers { permanent_uuid: "c2d19f52854a4cc9aad68ce2747ef4c1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 43165 } } peers { permanent_uuid: "321cb760c06a4335b282897a205ad779" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 36049 } }
I20260808 17:54:02.457373 23024 catalog_manager.cc:5495] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d19f52854a4cc9aad68ce2747ef4c1 (127.28.213.129). New cstate: current_term: 1 leader_uuid: "c2d19f52854a4cc9aad68ce2747ef4c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "771655c3b4be4765bb8e4f7a54148775" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d19f52854a4cc9aad68ce2747ef4c1" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 43165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "321cb760c06a4335b282897a205ad779" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 36049 } health_report { overall_health: UNKNOWN } } }
W20260808 17:54:02.475212 23480 tablet.cc:2369] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:54:02.475230 23685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.473277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38514 (local address 127.28.213.129:43165)
0808 17:54:02.473324 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:02.473326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:02.473335 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:54:02.473389 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:02.473390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:02.473404 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:02.473459 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:54:02.473559 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.473980 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.474624 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.474788 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.474827 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.474925 (+ 98us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:54:02.475009 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:54:02.475062 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:02.475170 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 17:54:02.475184 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:54:02.476718 23605 raft_consensus.cc:1261] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775 [term 1 FOLLOWER]: Refusing update from remote peer c2d19f52854a4cc9aad68ce2747ef4c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:54:02.476718 23418 raft_consensus.cc:1261] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779 [term 1 FOLLOWER]: Refusing update from remote peer c2d19f52854a4cc9aad68ce2747ef4c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:54:02.477013 23704 consensus_queue.cc:1035] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "771655c3b4be4765bb8e4f7a54148775" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 34541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:54:02.477133 23698 consensus_queue.cc:1035] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "321cb760c06a4335b282897a205ad779" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:54:02.479733 23710 mvcc.cc:205] Tried to move back new op lower bound from 7316322887582593024 to 7316322887503097856. Current Snapshot: MvccSnapshot[applied={T|T < 7316322887582593024}]
I20260808 17:54:02.481299 23024 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33880:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:54:02.481377 23024 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33880:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:54:02.482040 23024 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4fb257e0c5b7424faef22541140eff54: Sending DeleteTablet for 3 replicas of tablet f83fa2c18c52463c93d7c4a529b30979
I20260808 17:54:02.482339 23192 tablet_service.cc:1514] Processing DeleteTablet for tablet f83fa2c18c52463c93d7c4a529b30979 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:54:02 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:38512
I20260808 17:54:02.482355 23574 tablet_service.cc:1514] Processing DeleteTablet for tablet f83fa2c18c52463c93d7c4a529b30979 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:54:02 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:39156
I20260808 17:54:02.482396 23388 tablet_service.cc:1514] Processing DeleteTablet for tablet f83fa2c18c52463c93d7c4a529b30979 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:54:02 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:46360
I20260808 17:54:02.482635 23723 tablet_replica.cc:330] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1: stopping tablet replica
I20260808 17:54:02.482635 23724 tablet_replica.cc:330] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779: stopping tablet replica
I20260808 17:54:02.482728 23724 raft_consensus.cc:2229] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:54:02.482829 23724 raft_consensus.cc:2258] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:54:02.482838 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 23108
I20260808 17:54:02.482959 23723 raft_consensus.cc:2229] T f83fa2c18c52463c93d7c4a529b30979 P c2d19f52854a4cc9aad68ce2747ef4c1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:54:02.483223 23724 ts_tablet_manager.cc:1905] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:54:02.484941 23726 tablet_replica.cc:330] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775: stopping tablet replica
I20260808 17:54:02.485039 23726 raft_consensus.cc:2229] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:54:02.485149 23726 raft_consensus.cc:2258] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:54:02.485647 23724 ts_tablet_manager.cc:1918] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:54:02.485704 23724 log.cc:1196] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/f83fa2c18c52463c93d7c4a529b30979
I20260808 17:54:02.485924 23724 ts_tablet_manager.cc:1939] T f83fa2c18c52463c93d7c4a529b30979 P 321cb760c06a4335b282897a205ad779: Deleting consensus metadata
I20260808 17:54:02.486284 22995 catalog_manager.cc:4841] TS 321cb760c06a4335b282897a205ad779 (127.28.213.130:36049): tablet f83fa2c18c52463c93d7c4a529b30979 (table test-table [id=e1e5170a6351419099ae12f5e95eccce]) successfully deleted
I20260808 17:54:02.488160 23726 ts_tablet_manager.cc:1905] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:54:02.490408 23726 ts_tablet_manager.cc:1918] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:54:02.490485 23726 log.cc:1196] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/f83fa2c18c52463c93d7c4a529b30979
I20260808 17:54:02.490815 23726 ts_tablet_manager.cc:1939] T f83fa2c18c52463c93d7c4a529b30979 P 771655c3b4be4765bb8e4f7a54148775: Deleting consensus metadata
I20260808 17:54:02.491483 22994 catalog_manager.cc:4841] TS 771655c3b4be4765bb8e4f7a54148775 (127.28.213.131:34541): tablet f83fa2c18c52463c93d7c4a529b30979 (table test-table [id=e1e5170a6351419099ae12f5e95eccce]) successfully deleted
W20260808 17:54:02.500689 22999 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.213.129:43165 (error 108)
I20260808 17:54:02.500972 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 23291
I20260808 17:54:02.501102 23676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.500992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:43165 (local address 127.0.0.1:38530)
0808 17:54:02.501038 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:02.501073 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.129:43165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 17:54:02.505960 22999 catalog_manager.cc:4584] TS c2d19f52854a4cc9aad68ce2747ef4c1 (127.28.213.129:43165): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f83fa2c18c52463c93d7c4a529b30979: Network error: Client connection negotiation failed: client connection to 127.28.213.129:43165: connect: Connection refused (error 111)
I20260808 17:54:02.512514 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 23485
I20260808 17:54:02.521067 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 22976
2026-08-08T17:54:02Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2030 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T17:54:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:02Z Disabled control of system clock
I20260808 17:54:02.553119 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:40219
--webserver_interface=127.28.213.190
--webserver_port=0
--builtin_ntp_servers=127.28.213.148:34295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:40219
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 17:54:02.631264 23735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:02.631496 23735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:02.631516 23735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:02.632573 23735 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:02.632604 23735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:02.632615 23735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:02.632627 23735 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:02.632637 23735 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:02.633926 23735 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:34295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:40219
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:40219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:02.634110 23735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:02.634331 23735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 17:54:02.638851 23735 server_base.cc:1034] running on GCE node
W20260808 17:54:02.638790 23743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:02.638794 23744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:02.638844 23746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:02.639230 23735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:02.639497 23735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:02.640633 23735 hybrid_clock.cc:648] HybridClock initialized: now 1786211642640619 us; error 27 us; skew 500 ppm
I20260808 17:54:02.641768 23735 webserver.cc:460] Webserver started at http://127.28.213.190:37399/ using document root <none> and password file <none>
I20260808 17:54:02.641970 23735 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:02.642019 23735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:02.642138 23735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:02.643162 23735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "78015c46ff0f49ce865d81f649dcf16d"
format_stamp: "Formatted at 2026-08-08 17:54:02 on dist-test-slave-bndk"
server_key: "69f0f950fbffb837b5748608c8884e6f"
server_key_iv: "1cd7e84a3df196b678beb55aa8bb5574"
server_key_version: "encryptionkey@0"
I20260808 17:54:02.643494 23735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "78015c46ff0f49ce865d81f649dcf16d"
format_stamp: "Formatted at 2026-08-08 17:54:02 on dist-test-slave-bndk"
server_key: "69f0f950fbffb837b5748608c8884e6f"
server_key_iv: "1cd7e84a3df196b678beb55aa8bb5574"
server_key_version: "encryptionkey@0"
I20260808 17:54:02.644745 23735 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:54:02.645421 23755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:02.645557 23735 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:02.645637 23735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "78015c46ff0f49ce865d81f649dcf16d"
format_stamp: "Formatted at 2026-08-08 17:54:02 on dist-test-slave-bndk"
server_key: "69f0f950fbffb837b5748608c8884e6f"
server_key_iv: "1cd7e84a3df196b678beb55aa8bb5574"
server_key_version: "encryptionkey@0"
I20260808 17:54:02.645700 23735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:02.657586 23735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:02.657816 23735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:02.657930 23735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:02.661549 23735 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:40219
I20260808 17:54:02.661578 23823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:40219 every 8 connection(s)
I20260808 17:54:02.661857 23735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:02.662765 23824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:02.664788 23824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d: Bootstrap starting.
I20260808 17:54:02.665377 23824 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:02.665627 23824 log.cc:824] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:02.666244 23824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d: No bootstrap required, opened a new log
I20260808 17:54:02.666950 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 23735
I20260808 17:54:02.667043 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:02.667237 29526 external_mini_cluster.cc:1428] Setting key 43dad37ad1d5921d9f5eac22e2a26445
I20260808 17:54:02.668183 23824 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78015c46ff0f49ce865d81f649dcf16d" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40219 } }
I20260808 17:54:02.668321 23824 raft_consensus.cc:374] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:02.668355 23824 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78015c46ff0f49ce865d81f649dcf16d, State: Initialized, Role: FOLLOWER
I20260808 17:54:02.668479 23824 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78015c46ff0f49ce865d81f649dcf16d" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40219 } }
I20260808 17:54:02.668561 23824 raft_consensus.cc:388] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:02.668593 23824 raft_consensus.cc:482] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:02.668640 23824 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:02.669140 23824 raft_consensus.cc:504] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78015c46ff0f49ce865d81f649dcf16d" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40219 } }
I20260808 17:54:02.669251 23824 leader_election.cc:302] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78015c46ff0f49ce865d81f649dcf16d; no voters:
I20260808 17:54:02.669407 23824 leader_election.cc:288] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:02.669435 23830 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:02.669540 23830 raft_consensus.cc:686] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d [term 1 LEADER]: Becoming Leader. State: Replica: 78015c46ff0f49ce865d81f649dcf16d, State: Running, Role: LEADER
I20260808 17:54:02.669620 23830 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78015c46ff0f49ce865d81f649dcf16d" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40219 } }
I20260808 17:54:02.669654 23824 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:02.669981 23831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78015c46ff0f49ce865d81f649dcf16d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78015c46ff0f49ce865d81f649dcf16d" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40219 } } }
I20260808 17:54:02.670063 23831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:02.670282 23832 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78015c46ff0f49ce865d81f649dcf16d. Latest consensus state: current_term: 1 leader_uuid: "78015c46ff0f49ce865d81f649dcf16d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78015c46ff0f49ce865d81f649dcf16d" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 40219 } } }
I20260808 17:54:02.670615 23832 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:02.670837 23835 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:02.671303 23835 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:02.672785 23835 catalog_manager.cc:1347] Generated new cluster ID: 965c529731254cea81b7ea9e76138ba4
I20260808 17:54:02.672875 23835 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:02.673096 23829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.667710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53352 (local address 127.28.213.190:40219)
0808 17:54:02.667887 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:02.667893 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:02.667918 (+ 25us) server_negotiation.cc:407] Connection header received
0808 17:54:02.668145 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:02.668150 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:02.668199 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:02.668299 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:02.668549 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.670098 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.671143 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.671651 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.671762 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.672386 (+ 624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:02.672390 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:02.672390 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:02.672577 (+ 187us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:02.672617 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:02.672632 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:02.672732 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:02.672817 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 17:54:02.672893 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":66,"threads_started":1}
I20260808 17:54:02.689107 23835 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:02.689601 23835 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:02.695638 23835 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d: Generated new TSK 0
I20260808 17:54:02.695786 23835 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:02.701689 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:40219
--builtin_ntp_servers=127.28.213.148:34295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 17:54:02.795662 23854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:02.795852 23854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:02.795883 23854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:02.796964 23854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:02.797001 23854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:02.797034 23854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:54:02.798377 23854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:34295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:40219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:02.798624 23854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:02.798902 23854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:02.804329 23859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:02.804354 23860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:02.804553 23854 server_base.cc:1034] running on GCE node
W20260808 17:54:02.804354 23862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:02.804829 23854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:02.805084 23854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:02.806236 23854 hybrid_clock.cc:648] HybridClock initialized: now 1786211642806225 us; error 28 us; skew 500 ppm
I20260808 17:54:02.807307 23854 webserver.cc:460] Webserver started at http://127.28.213.129:35171/ using document root <none> and password file <none>
I20260808 17:54:02.807492 23854 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:02.807530 23854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:02.807621 23854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:02.808542 23854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "42c5c2f949394bd4a6acf51c2cdc551e"
format_stamp: "Formatted at 2026-08-08 17:54:02 on dist-test-slave-bndk"
server_key: "4bf1a9813f74bbce411119e8c3156603"
server_key_iv: "f77da3d6cd86bbee367033a52c02de06"
server_key_version: "encryptionkey@0"
I20260808 17:54:02.808828 23854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "42c5c2f949394bd4a6acf51c2cdc551e"
format_stamp: "Formatted at 2026-08-08 17:54:02 on dist-test-slave-bndk"
server_key: "4bf1a9813f74bbce411119e8c3156603"
server_key_iv: "f77da3d6cd86bbee367033a52c02de06"
server_key_version: "encryptionkey@0"
I20260808 17:54:02.809996 23854 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:54:02.810590 23872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:02.810737 23854 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:02.810813 23854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "42c5c2f949394bd4a6acf51c2cdc551e"
format_stamp: "Formatted at 2026-08-08 17:54:02 on dist-test-slave-bndk"
server_key: "4bf1a9813f74bbce411119e8c3156603"
server_key_iv: "f77da3d6cd86bbee367033a52c02de06"
server_key_version: "encryptionkey@0"
I20260808 17:54:02.810866 23854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:02.821730 23854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:02.821935 23854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:02.822026 23854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:02.822175 23854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:54:02.822422 23854 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:54:02.822451 23854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:02.822476 23854 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:54:02.822494 23854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:02.827611 23854 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:38513
I20260808 17:54:02.827679 24035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:38513 every 8 connection(s)
I20260808 17:54:02.827924 23854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:54:02.832635 23829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.828530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:54855 (local address 127.28.213.190:40219)
0808 17:54:02.828571 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:02.828573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:02.828795 (+ 222us) server_negotiation.cc:407] Connection header received
0808 17:54:02.829303 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:02.829304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:02.829318 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:02.829392 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:02.830015 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.830508 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.831432 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.831627 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.831681 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.832384 (+ 703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:02.832386 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:02.832386 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:02.832393 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:02.832408 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:02.832413 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:02.832457 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:02.832532 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 17:54:02.832558 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:54:02.832809 24038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.828510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40219 (local address 127.28.213.129:54855)
0808 17:54:02.828695 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:02.828724 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:02.829184 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:02.829462 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:02.829466 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:02.829475 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:02.829931 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.829935 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.830592 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.830593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.831353 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.831356 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.831698 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.831699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.831820 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.832254 (+ 434us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:54:02.832255 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:02.832280 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:54:02.832302 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:02.832462 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:02.832467 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:02.832470 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:54:02.832530 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 17:54:02.832624 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":93,"threads_started":1}
I20260808 17:54:02.833237 24036 heartbeater.cc:347] Connected to a master server at 127.28.213.190:40219
I20260808 17:54:02.833325 24036 heartbeater.cc:464] Registering TS with master...
I20260808 17:54:02.833482 24036 heartbeater.cc:511] Master 127.28.213.190:40219 requested a full tablet report, sending...
I20260808 17:54:02.833899 23774 ts_manager.cc:194] Registered new tserver with Master: 42c5c2f949394bd4a6acf51c2cdc551e (127.28.213.129:38513)
I20260808 17:54:02.834471 23774 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.213.129:54855
I20260808 17:54:02.837584 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 23854
I20260808 17:54:02.837669 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:54:02.837841 29526 external_mini_cluster.cc:1428] Setting key 61db83ab155e91e46b3b33c2e93f4c29
I20260808 17:54:02.838611 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:40219
--builtin_ntp_servers=127.28.213.148:34295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 17:54:02.917850 24039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:02.918048 24039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:02.918076 24039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:02.919159 24039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:02.919195 24039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:02.919227 24039 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:54:02.920511 24039 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:34295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:40219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:02.920729 24039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:02.920992 24039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:02.925522 24049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:02.925523 24050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:02.925623 24039 server_base.cc:1034] running on GCE node
W20260808 17:54:02.925542 24052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:02.925931 24039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:02.926129 24039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:02.927255 24039 hybrid_clock.cc:648] HybridClock initialized: now 1786211642927248 us; error 26 us; skew 500 ppm
I20260808 17:54:02.928287 24039 webserver.cc:460] Webserver started at http://127.28.213.130:41541/ using document root <none> and password file <none>
I20260808 17:54:02.928483 24039 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:02.928526 24039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:02.928645 24039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:02.929718 24039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "c00bd22d5d664fc18630d69a6c159f80"
format_stamp: "Formatted at 2026-08-08 17:54:02 on dist-test-slave-bndk"
server_key: "d2b86619fa04fc624bab0c5be19658ee"
server_key_iv: "0d97fe31c57ec27c223a8ce6554043d1"
server_key_version: "encryptionkey@0"
I20260808 17:54:02.930044 24039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "c00bd22d5d664fc18630d69a6c159f80"
format_stamp: "Formatted at 2026-08-08 17:54:02 on dist-test-slave-bndk"
server_key: "d2b86619fa04fc624bab0c5be19658ee"
server_key_iv: "0d97fe31c57ec27c223a8ce6554043d1"
server_key_version: "encryptionkey@0"
I20260808 17:54:02.931196 24039 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:54:02.931815 24063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:02.931951 24039 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:02.932032 24039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "c00bd22d5d664fc18630d69a6c159f80"
format_stamp: "Formatted at 2026-08-08 17:54:02 on dist-test-slave-bndk"
server_key: "d2b86619fa04fc624bab0c5be19658ee"
server_key_iv: "0d97fe31c57ec27c223a8ce6554043d1"
server_key_version: "encryptionkey@0"
I20260808 17:54:02.932091 24039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:02.958988 24039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:02.959265 24039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:02.959394 24039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:02.959618 24039 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:54:02.959944 24039 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:54:02.959977 24039 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:02.960012 24039 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:54:02.960032 24039 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:02.965454 24039 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:40183
I20260808 17:54:02.965514 24217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:40183 every 8 connection(s)
I20260808 17:54:02.965796 24039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:54:02.970558 23829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.966455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:35113 (local address 127.28.213.190:40219)
0808 17:54:02.966508 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:02.966509 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:02.966726 (+ 217us) server_negotiation.cc:407] Connection header received
0808 17:54:02.967186 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:02.967187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:02.967196 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:02.967251 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:02.967874 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.968345 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.969341 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.969529 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.969577 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.970302 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:02.970304 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:02.970305 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:02.970309 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:02.970325 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:02.970347 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:02.970396 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:02.970477 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 17:54:02.970499 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:54:02.970745 24220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:02.966415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40219 (local address 127.28.213.130:35113)
0808 17:54:02.966610 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:02.966649 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:02.967109 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:02.967317 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:02.967321 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:02.967329 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:02.967807 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.967812 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.968420 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.968421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.969281 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:02.969285 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:02.969585 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:02.969586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:02.969686 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:02.970157 (+ 471us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:54:02.970157 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:02.970185 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:54:02.970225 (+ 40us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:02.970402 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:02.970408 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:02.970411 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:54:02.970471 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 17:54:02.970549 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":88,"threads_started":1}
I20260808 17:54:02.971132 24218 heartbeater.cc:347] Connected to a master server at 127.28.213.190:40219
I20260808 17:54:02.971206 24218 heartbeater.cc:464] Registering TS with master...
I20260808 17:54:02.971403 24218 heartbeater.cc:511] Master 127.28.213.190:40219 requested a full tablet report, sending...
I20260808 17:54:02.971733 23774 ts_manager.cc:194] Registered new tserver with Master: c00bd22d5d664fc18630d69a6c159f80 (127.28.213.130:40183)
I20260808 17:54:02.972088 23774 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.213.130:35113
I20260808 17:54:02.973706 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 24039
I20260808 17:54:02.973779 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:54:02.973935 29526 external_mini_cluster.cc:1428] Setting key f8924c33d02ed64861812671cbbc72c4
I20260808 17:54:02.974716 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:40219
--builtin_ntp_servers=127.28.213.148:34295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 17:54:03.055074 24221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:03.055255 24221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:03.055275 24221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:03.056331 24221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:03.056365 24221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:03.056388 24221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:54:03.057664 24221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:34295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:40219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:03.057829 24221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:03.058048 24221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:03.062428 24229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:03.062443 24228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:03.062448 24234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:03.062695 24221 server_base.cc:1034] running on GCE node
I20260808 17:54:03.062879 24221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:03.063078 24221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:03.064210 24221 hybrid_clock.cc:648] HybridClock initialized: now 1786211643064195 us; error 31 us; skew 500 ppm
I20260808 17:54:03.065408 24221 webserver.cc:460] Webserver started at http://127.28.213.131:37659/ using document root <none> and password file <none>
I20260808 17:54:03.065614 24221 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:03.065660 24221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:03.065760 24221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:03.066720 24221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "0a2a8de177574ede83942fcc3511f1bf"
format_stamp: "Formatted at 2026-08-08 17:54:03 on dist-test-slave-bndk"
server_key: "5575c49fb0b1aa7b699c44f80cf7b4c8"
server_key_iv: "31a0b6fa97ba0a73faa107986f870a6c"
server_key_version: "encryptionkey@0"
I20260808 17:54:03.067036 24221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "0a2a8de177574ede83942fcc3511f1bf"
format_stamp: "Formatted at 2026-08-08 17:54:03 on dist-test-slave-bndk"
server_key: "5575c49fb0b1aa7b699c44f80cf7b4c8"
server_key_iv: "31a0b6fa97ba0a73faa107986f870a6c"
server_key_version: "encryptionkey@0"
I20260808 17:54:03.068207 24221 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:54:03.068862 24244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:03.068996 24221 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:03.069075 24221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "0a2a8de177574ede83942fcc3511f1bf"
format_stamp: "Formatted at 2026-08-08 17:54:03 on dist-test-slave-bndk"
server_key: "5575c49fb0b1aa7b699c44f80cf7b4c8"
server_key_iv: "31a0b6fa97ba0a73faa107986f870a6c"
server_key_version: "encryptionkey@0"
I20260808 17:54:03.069136 24221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:03.079856 24221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:03.080075 24221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:03.080188 24221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:03.080381 24221 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:54:03.080660 24221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:54:03.080693 24221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:03.080717 24221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:54:03.080734 24221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:03.085990 24221 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:42361
I20260808 17:54:03.086027 24400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:42361 every 8 connection(s)
I20260808 17:54:03.086304 24221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:54:03.089587 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 24221
I20260808 17:54:03.089687 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:54:03.089907 29526 external_mini_cluster.cc:1428] Setting key 7f5feeb59a9b805143b66ed226dd9ee2
I20260808 17:54:03.091030 23829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:03.086919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:59725 (local address 127.28.213.190:40219)
0808 17:54:03.086991 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:03.086993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:03.087147 (+ 154us) server_negotiation.cc:407] Connection header received
0808 17:54:03.087544 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:03.087545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:03.087555 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:03.087618 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:03.088211 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.088709 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.089657 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.089944 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.090013 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:03.090779 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:03.090780 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:03.090781 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:03.090785 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:03.090804 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:03.090809 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:03.090859 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:03.090950 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 17:54:03.090975 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 17:54:03.091188 24403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:03.086894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:40219 (local address 127.28.213.131:59725)
0808 17:54:03.087050 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:03.087079 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:03.087476 (+ 397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:03.087665 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:03.087668 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:03.087676 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:03.088119 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:03.088123 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.088774 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.088774 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:03.089578 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:03.089581 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.090050 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.090051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:03.090196 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:03.090649 (+ 453us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:54:03.090649 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:03.090676 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:54:03.090702 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:03.090881 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:03.090886 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:03.090889 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:54:03.090949 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 17:54:03.091022 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":77,"threads_started":1}
I20260808 17:54:03.091631 24401 heartbeater.cc:347] Connected to a master server at 127.28.213.190:40219
I20260808 17:54:03.091706 24401 heartbeater.cc:464] Registering TS with master...
I20260808 17:54:03.091835 24401 heartbeater.cc:511] Master 127.28.213.190:40219 requested a full tablet report, sending...
I20260808 17:54:03.092134 23774 ts_manager.cc:194] Registered new tserver with Master: 0a2a8de177574ede83942fcc3511f1bf (127.28.213.131:42361)
I20260808 17:54:03.092476 23774 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.213.131:59725
I20260808 17:54:03.101516 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:54:03.105307 23829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:03.102732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53360 (local address 127.28.213.190:40219)
0808 17:54:03.102786 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:03.102788 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:03.102888 (+ 100us) server_negotiation.cc:407] Connection header received
0808 17:54:03.102946 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:03.102947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:03.102959 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:03.103003 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:03.103152 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.103600 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.104291 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.104474 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.104526 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:03.105070 (+ 544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:03.105071 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:03.105071 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:03.105075 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:03.105088 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:03.105092 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:03.105136 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:03.105192 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 17:54:03.105237 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:54:03.106585 23774 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:54:03.108085 23774 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:54:03.114176 24420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:03.110273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58404 (local address 127.28.213.131:42361)
0808 17:54:03.110435 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:03.110439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:03.110838 (+ 399us) server_negotiation.cc:407] Connection header received
0808 17:54:03.110876 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:03.110878 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:03.110891 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:03.110961 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:03.111085 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.112077 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.113110 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.113802 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.113885 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:03.113968 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:03.114064 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 17:54:03.114096 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":100,"threads_started":1}
I20260808 17:54:03.114179 24412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:03.110009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:42361 (local address 127.0.0.1:58404)
0808 17:54:03.110712 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:03.110722 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:03.110778 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:03.110958 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:03.110960 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:03.110962 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:03.110999 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:03.111001 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.112147 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.112149 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:03.113042 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:03.113044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.113898 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.113899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:03.113973 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:03.113990 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 17:54:03.114053 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 17:54:03.114104 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"mutex_wait_us":34,"thread_start_us":88,"threads_started":1}
I20260808 17:54:03.114315 24411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:03.109987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:40183 (local address 127.0.0.1:59692)
0808 17:54:03.110163 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:03.110201 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:03.110265 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:03.110638 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:03.110641 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:03.110643 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:03.110712 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:03.110713 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.111976 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.111978 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:03.113237 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:03.113240 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.114114 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.114115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:03.114173 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:03.114176 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:54:03.114220 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 17:54:03.114256 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":3,"thread_start_us":57,"threads_started":1}
I20260808 17:54:03.114565 24418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:03.110104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59692 (local address 127.28.213.130:40183)
0808 17:54:03.110483 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:03.110487 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:03.110496 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:54:03.110530 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:03.110531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:03.110544 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:03.110621 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:03.110795 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.111891 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.113332 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.113934 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.113999 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:03.114080 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:03.114394 (+ 314us) server_negotiation.cc:299] Negotiation successful
0808 17:54:03.114496 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":81,"threads_started":1}
I20260808 17:54:03.114883 24307 tablet_service.cc:1467] Processing CreateTablet for tablet d81b32183e5449c9bb6feac3a642538d (DEFAULT_TABLE table=test-table [id=e9e68a572a384b42b25582907d582afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:54:03.115142 24419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:03.110175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:38513 (local address 127.0.0.1:59378)
0808 17:54:03.111042 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:03.111051 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:03.111100 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:03.111249 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:03.111250 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:03.111252 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:03.111300 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:03.111302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.112179 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.112180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:03.113318 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:03.113320 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.114918 (+ 1598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.114919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:03.114983 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:03.114988 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:54:03.115037 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 17:54:03.115078 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":851,"mutex_wait_us":1,"thread_start_us":69,"threads_started":1}
I20260808 17:54:03.115286 24307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d81b32183e5449c9bb6feac3a642538d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:03.115198 24125 tablet_service.cc:1467] Processing CreateTablet for tablet d81b32183e5449c9bb6feac3a642538d (DEFAULT_TABLE table=test-table [id=e9e68a572a384b42b25582907d582afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:54:03.115427 24421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:03.110290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59378 (local address 127.28.213.129:38513)
0808 17:54:03.110450 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:03.110454 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:03.111109 (+ 655us) server_negotiation.cc:407] Connection header received
0808 17:54:03.111158 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:03.111160 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:03.111175 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:03.111242 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:03.111353 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.112088 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.113392 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.114091 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.114158 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:03.114881 (+ 723us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:03.115288 (+ 407us) server_negotiation.cc:299] Negotiation successful
0808 17:54:03.115335 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":84,"threads_started":1}
I20260808 17:54:03.115525 24125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d81b32183e5449c9bb6feac3a642538d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:03.116017 23940 tablet_service.cc:1467] Processing CreateTablet for tablet d81b32183e5449c9bb6feac3a642538d (DEFAULT_TABLE table=test-table [id=e9e68a572a384b42b25582907d582afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:54:03.116346 23940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d81b32183e5449c9bb6feac3a642538d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:03.117995 24425 tablet_bootstrap.cc:492] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf: Bootstrap starting.
I20260808 17:54:03.118558 24425 tablet_bootstrap.cc:654] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:03.118706 24426 tablet_bootstrap.cc:492] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80: Bootstrap starting.
I20260808 17:54:03.118991 24425 log.cc:824] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:03.119310 24426 tablet_bootstrap.cc:654] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:03.119613 24426 log.cc:824] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:03.119642 24429 tablet_bootstrap.cc:492] T d81b32183e5449c9bb6feac3a642538d P 42c5c2f949394bd4a6acf51c2cdc551e: Bootstrap starting.
I20260808 17:54:03.119776 24425 tablet_bootstrap.cc:492] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf: No bootstrap required, opened a new log
I20260808 17:54:03.119856 24425 ts_tablet_manager.cc:1397] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:54:03.120218 24429 tablet_bootstrap.cc:654] T d81b32183e5449c9bb6feac3a642538d P 42c5c2f949394bd4a6acf51c2cdc551e: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:03.120376 24426 tablet_bootstrap.cc:492] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80: No bootstrap required, opened a new log
I20260808 17:54:03.120443 24426 ts_tablet_manager.cc:1397] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:54:03.120540 24429 log.cc:824] T d81b32183e5449c9bb6feac3a642538d P 42c5c2f949394bd4a6acf51c2cdc551e: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:03.121407 24429 tablet_bootstrap.cc:492] T d81b32183e5449c9bb6feac3a642538d P 42c5c2f949394bd4a6acf51c2cdc551e: No bootstrap required, opened a new log
I20260808 17:54:03.121477 24429 ts_tablet_manager.cc:1397] T d81b32183e5449c9bb6feac3a642538d P 42c5c2f949394bd4a6acf51c2cdc551e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:54:03.122026 24425 raft_consensus.cc:348] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00bd22d5d664fc18630d69a6c159f80" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 40183 } } peers { permanent_uuid: "42c5c2f949394bd4a6acf51c2cdc551e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38513 } } peers { permanent_uuid: "0a2a8de177574ede83942fcc3511f1bf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42361 } }
I20260808 17:54:03.122187 24425 raft_consensus.cc:374] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:03.122432 24425 raft_consensus.cc:729] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2a8de177574ede83942fcc3511f1bf, State: Initialized, Role: FOLLOWER
I20260808 17:54:03.122560 24425 consensus_queue.cc:260] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00bd22d5d664fc18630d69a6c159f80" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 40183 } } peers { permanent_uuid: "42c5c2f949394bd4a6acf51c2cdc551e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38513 } } peers { permanent_uuid: "0a2a8de177574ede83942fcc3511f1bf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42361 } }
I20260808 17:54:03.122813 24425 ts_tablet_manager.cc:1428] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:54:03.122931 24401 heartbeater.cc:503] Master 127.28.213.190:40219 was elected leader, sending a full tablet report...
I20260808 17:54:03.122754 24426 raft_consensus.cc:348] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00bd22d5d664fc18630d69a6c159f80" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 40183 } } peers { permanent_uuid: "42c5c2f949394bd4a6acf51c2cdc551e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38513 } } peers { permanent_uuid: "0a2a8de177574ede83942fcc3511f1bf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42361 } }
I20260808 17:54:03.123227 24426 raft_consensus.cc:374] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:03.123284 24426 raft_consensus.cc:729] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00bd22d5d664fc18630d69a6c159f80, State: Initialized, Role: FOLLOWER
I20260808 17:54:03.123453 24426 consensus_queue.cc:260] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00bd22d5d664fc18630d69a6c159f80" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 40183 } } peers { permanent_uuid: "42c5c2f949394bd4a6acf51c2cdc551e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38513 } } peers { permanent_uuid: "0a2a8de177574ede83942fcc3511f1bf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42361 } }
I20260808 17:54:03.123762 24426 ts_tablet_manager.cc:1428] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 17:54:03.123807 24218 heartbeater.cc:503] Master 127.28.213.190:40219 was elected leader, sending a full tablet report...
I20260808 17:54:03.124318 24429 raft_consensus.cc:348] T d81b32183e5449c9bb6feac3a642538d P 42c5c2f949394bd4a6acf51c2cdc551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00bd22d5d664fc18630d69a6c159f80" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 40183 } } peers { permanent_uuid: "42c5c2f949394bd4a6acf51c2cdc551e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38513 } } peers { permanent_uuid: "0a2a8de177574ede83942fcc3511f1bf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42361 } }
I20260808 17:54:03.124480 24429 raft_consensus.cc:374] T d81b32183e5449c9bb6feac3a642538d P 42c5c2f949394bd4a6acf51c2cdc551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:03.124534 24429 raft_consensus.cc:729] T d81b32183e5449c9bb6feac3a642538d P 42c5c2f949394bd4a6acf51c2cdc551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c5c2f949394bd4a6acf51c2cdc551e, State: Initialized, Role: FOLLOWER
I20260808 17:54:03.124650 24429 consensus_queue.cc:260] T d81b32183e5449c9bb6feac3a642538d P 42c5c2f949394bd4a6acf51c2cdc551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00bd22d5d664fc18630d69a6c159f80" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 40183 } } peers { permanent_uuid: "42c5c2f949394bd4a6acf51c2cdc551e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38513 } } peers { permanent_uuid: "0a2a8de177574ede83942fcc3511f1bf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42361 } }
I20260808 17:54:03.124883 24429 ts_tablet_manager.cc:1428] T d81b32183e5449c9bb6feac3a642538d P 42c5c2f949394bd4a6acf51c2cdc551e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:54:03.124949 24036 heartbeater.cc:503] Master 127.28.213.190:40219 was elected leader, sending a full tablet report...
I20260808 17:54:03.200837 24435 raft_consensus.cc:482] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:54:03.200953 24435 raft_consensus.cc:504] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00bd22d5d664fc18630d69a6c159f80" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 40183 } } peers { permanent_uuid: "42c5c2f949394bd4a6acf51c2cdc551e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38513 } } peers { permanent_uuid: "0a2a8de177574ede83942fcc3511f1bf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42361 } }
I20260808 17:54:03.201297 24435 leader_election.cc:288] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c5c2f949394bd4a6acf51c2cdc551e (127.28.213.129:38513), 0a2a8de177574ede83942fcc3511f1bf (127.28.213.131:42361)
I20260808 17:54:03.204051 24220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:03.201458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:38513 (local address 127.28.213.130:36345)
0808 17:54:03.201518 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:03.201545 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:03.201592 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:03.201752 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:03.201752 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:03.201754 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:03.201825 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:03.201826 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.202485 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.202486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:03.203279 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:03.203282 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.203820 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.203821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:03.203904 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:03.203908 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:54:03.203957 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 17:54:03.203995 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 17:54:03.204066 24421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:03.201519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:36345 (local address 127.28.213.129:38513)
0808 17:54:03.201565 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:03.201568 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:03.201580 (+ 12us) server_negotiation.cc:407] Connection header received
0808 17:54:03.201669 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:03.201670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:03.201683 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:03.201741 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:03.201888 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.202419 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.203350 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.203755 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.203807 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:03.203814 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:03.203962 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 17:54:03.203998 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:54:03.204213 24420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:03.201512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:45547 (local address 127.28.213.131:42361)
0808 17:54:03.201597 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:03.201599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:03.201744 (+ 145us) server_negotiation.cc:407] Connection header received
0808 17:54:03.201781 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:03.201781 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:03.201791 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:03.201847 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:03.202004 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.202474 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.203498 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.203861 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.203927 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:03.203934 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:03.204094 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 17:54:03.204136 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 17:54:03.204421 24438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:03.201458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:42361 (local address 127.28.213.130:45547)
0808 17:54:03.201669 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:03.201678 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:03.201735 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:03.201859 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:03.201859 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:03.201861 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:03.201943 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:03.201945 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.202546 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.202547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:03.203413 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:03.203415 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.203938 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.203939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:03.204024 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:03.204027 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:54:03.204081 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 17:54:03.204244 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":55,"thread_start_us":86,"threads_started":1}
I20260808 17:54:03.204568 23971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d81b32183e5449c9bb6feac3a642538d" candidate_uuid: "c00bd22d5d664fc18630d69a6c159f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c5c2f949394bd4a6acf51c2cdc551e" is_pre_election: true
I20260808 17:54:03.204710 23971 raft_consensus.cc:2454] T d81b32183e5449c9bb6feac3a642538d P 42c5c2f949394bd4a6acf51c2cdc551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00bd22d5d664fc18630d69a6c159f80 in term 0.
I20260808 17:54:03.204842 24338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d81b32183e5449c9bb6feac3a642538d" candidate_uuid: "c00bd22d5d664fc18630d69a6c159f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2a8de177574ede83942fcc3511f1bf" is_pre_election: true
I20260808 17:54:03.204943 24065 leader_election.cc:302] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c5c2f949394bd4a6acf51c2cdc551e, c00bd22d5d664fc18630d69a6c159f80; no voters:
I20260808 17:54:03.204988 24338 raft_consensus.cc:2454] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00bd22d5d664fc18630d69a6c159f80 in term 0.
I20260808 17:54:03.205058 24435 raft_consensus.cc:2781] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:54:03.205129 24435 raft_consensus.cc:482] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:54:03.205149 24435 raft_consensus.cc:3037] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:03.205840 24435 raft_consensus.cc:504] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00bd22d5d664fc18630d69a6c159f80" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 40183 } } peers { permanent_uuid: "42c5c2f949394bd4a6acf51c2cdc551e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38513 } } peers { permanent_uuid: "0a2a8de177574ede83942fcc3511f1bf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42361 } }
I20260808 17:54:03.206019 24435 leader_election.cc:288] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [CANDIDATE]: Term 1 election: Requested vote from peers 42c5c2f949394bd4a6acf51c2cdc551e (127.28.213.129:38513), 0a2a8de177574ede83942fcc3511f1bf (127.28.213.131:42361)
I20260808 17:54:03.206080 24338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d81b32183e5449c9bb6feac3a642538d" candidate_uuid: "c00bd22d5d664fc18630d69a6c159f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2a8de177574ede83942fcc3511f1bf"
I20260808 17:54:03.206158 24338 raft_consensus.cc:3037] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:03.206827 24338 raft_consensus.cc:2454] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00bd22d5d664fc18630d69a6c159f80 in term 1.
I20260808 17:54:03.206933 23971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d81b32183e5449c9bb6feac3a642538d" candidate_uuid: "c00bd22d5d664fc18630d69a6c159f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c5c2f949394bd4a6acf51c2cdc551e"
I20260808 17:54:03.206996 24067 leader_election.cc:302] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2a8de177574ede83942fcc3511f1bf, c00bd22d5d664fc18630d69a6c159f80; no voters:
I20260808 17:54:03.207012 23971 raft_consensus.cc:3037] T d81b32183e5449c9bb6feac3a642538d P 42c5c2f949394bd4a6acf51c2cdc551e [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:03.207083 24435 raft_consensus.cc:2781] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:03.207221 24435 raft_consensus.cc:686] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [term 1 LEADER]: Becoming Leader. State: Replica: c00bd22d5d664fc18630d69a6c159f80, State: Running, Role: LEADER
I20260808 17:54:03.207312 24435 consensus_queue.cc:237] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00bd22d5d664fc18630d69a6c159f80" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 40183 } } peers { permanent_uuid: "42c5c2f949394bd4a6acf51c2cdc551e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38513 } } peers { permanent_uuid: "0a2a8de177574ede83942fcc3511f1bf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42361 } }
I20260808 17:54:03.207926 23971 raft_consensus.cc:2454] T d81b32183e5449c9bb6feac3a642538d P 42c5c2f949394bd4a6acf51c2cdc551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00bd22d5d664fc18630d69a6c159f80 in term 1.
I20260808 17:54:03.208076 23774 catalog_manager.cc:5495] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 reported cstate change: term changed from 0 to 1, leader changed from <none> to c00bd22d5d664fc18630d69a6c159f80 (127.28.213.130). New cstate: current_term: 1 leader_uuid: "c00bd22d5d664fc18630d69a6c159f80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00bd22d5d664fc18630d69a6c159f80" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 40183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c5c2f949394bd4a6acf51c2cdc551e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a2a8de177574ede83942fcc3511f1bf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42361 } health_report { overall_health: UNKNOWN } } }
W20260808 17:54:03.216243 24219 tablet.cc:2369] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:54:03.231058 24418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:03.228998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59694 (local address 127.28.213.130:40183)
0808 17:54:03.229043 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:03.229045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:03.229070 (+ 25us) server_negotiation.cc:407] Connection header received
0808 17:54:03.229135 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:03.229136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:03.229150 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:03.229205 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:54:03.229332 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.229753 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.230499 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:03.230678 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:03.230728 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:03.230825 (+ 97us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:54:03.230915 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:54:03.230969 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:03.230984 (+ 15us) server_negotiation.cc:299] Negotiation successful
0808 17:54:03.230999 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:54:03.232546 23971 raft_consensus.cc:1261] T d81b32183e5449c9bb6feac3a642538d P 42c5c2f949394bd4a6acf51c2cdc551e [term 1 FOLLOWER]: Refusing update from remote peer c00bd22d5d664fc18630d69a6c159f80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:54:03.232568 24338 raft_consensus.cc:1261] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf [term 1 FOLLOWER]: Refusing update from remote peer c00bd22d5d664fc18630d69a6c159f80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:54:03.232872 24439 consensus_queue.cc:1035] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c5c2f949394bd4a6acf51c2cdc551e" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 38513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:54:03.232995 24435 consensus_queue.cc:1035] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2a8de177574ede83942fcc3511f1bf" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:54:03.235411 24444 mvcc.cc:205] Tried to move back new op lower bound from 7316322890678398976 to 7316322890577768448. Current Snapshot: MvccSnapshot[applied={T|T < 7316322890678398976}]
I20260808 17:54:03.235491 24445 mvcc.cc:205] Tried to move back new op lower bound from 7316322890678398976 to 7316322890577768448. Current Snapshot: MvccSnapshot[applied={T|T < 7316322890678398976}]
I20260808 17:54:03.237697 23774 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:54:03.237774 23774 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:54:03.238415 23774 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 78015c46ff0f49ce865d81f649dcf16d: Sending DeleteTablet for 3 replicas of tablet d81b32183e5449c9bb6feac3a642538d
I20260808 17:54:03.238742 23940 tablet_service.cc:1514] Processing DeleteTablet for tablet d81b32183e5449c9bb6feac3a642538d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:54:03 UTC) from {username='slave'} at 127.0.0.1:59378
I20260808 17:54:03.238758 24125 tablet_service.cc:1514] Processing DeleteTablet for tablet d81b32183e5449c9bb6feac3a642538d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:54:03 UTC) from {username='slave'} at 127.0.0.1:59692
I20260808 17:54:03.238969 24458 tablet_replica.cc:330] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80: stopping tablet replica
I20260808 17:54:03.238972 24307 tablet_service.cc:1514] Processing DeleteTablet for tablet d81b32183e5449c9bb6feac3a642538d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:54:03 UTC) from {username='slave'} at 127.0.0.1:58404
I20260808 17:54:03.239053 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 23854
I20260808 17:54:03.239167 24458 raft_consensus.cc:2229] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:54:03.239310 24458 raft_consensus.cc:2258] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:54:03.245862 24459 tablet_replica.cc:330] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf: stopping tablet replica
I20260808 17:54:03.245970 24459 raft_consensus.cc:2229] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:54:03.246071 24459 raft_consensus.cc:2258] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:54:03.246444 24458 ts_tablet_manager.cc:1905] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:54:03.246560 24459 ts_tablet_manager.cc:1905] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:54:03.248112 24458 ts_tablet_manager.cc:1918] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:54:03.248210 24459 ts_tablet_manager.cc:1918] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:54:03.248235 24458 log.cc:1196] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/d81b32183e5449c9bb6feac3a642538d
I20260808 17:54:03.248284 24459 log.cc:1196] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/d81b32183e5449c9bb6feac3a642538d
I20260808 17:54:03.248545 24459 ts_tablet_manager.cc:1939] T d81b32183e5449c9bb6feac3a642538d P 0a2a8de177574ede83942fcc3511f1bf: Deleting consensus metadata
I20260808 17:54:03.248689 24458 ts_tablet_manager.cc:1939] T d81b32183e5449c9bb6feac3a642538d P c00bd22d5d664fc18630d69a6c159f80: Deleting consensus metadata
I20260808 17:54:03.248970 23758 catalog_manager.cc:4841] TS 0a2a8de177574ede83942fcc3511f1bf (127.28.213.131:42361): tablet d81b32183e5449c9bb6feac3a642538d (table test-table [id=e9e68a572a384b42b25582907d582afe]) successfully deleted
I20260808 17:54:03.249167 23757 catalog_manager.cc:4841] TS c00bd22d5d664fc18630d69a6c159f80 (127.28.213.130:40183): tablet d81b32183e5449c9bb6feac3a642538d (table test-table [id=e9e68a572a384b42b25582907d582afe]) successfully deleted
W20260808 17:54:03.250464 23757 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.213.129:38513 (error 108)
I20260808 17:54:03.250728 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 24039
I20260808 17:54:03.250880 24419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:03.250760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:38513 (local address 127.0.0.1:59386)
0808 17:54:03.250804 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:03.250840 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.129:38513: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260808 17:54:03.261356 23757 catalog_manager.cc:4584] TS 42c5c2f949394bd4a6acf51c2cdc551e (127.28.213.129:38513): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d81b32183e5449c9bb6feac3a642538d: Network error: Client connection negotiation failed: client connection to 127.28.213.129:38513: connect: Connection refused (error 111)
I20260808 17:54:03.264648 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 24221
I20260808 17:54:03.272734 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 23735
2026-08-08T17:54:03Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (749 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:03 dist-test-slave-bndk krb5kdc[24464](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:03 dist-test-slave-bndk krb5kdc[24464](info): set up 2 sockets
Aug 08 17:54:03 dist-test-slave-bndk krb5kdc[24464](info): commencing operation
krb5kdc: starting...
W20260808 17:54:04.408428 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:04 dist-test-slave-bndk krb5kdc[24464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211644, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:54:04.515277 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:45221
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:44383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:45221
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:04.593379 24480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:04.593559 24480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:04.593580 24480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:04.594674 24480 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:04.594715 24480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:04.594728 24480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:04.594739 24480 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:04.594750 24480 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:04.596146 24480 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:44383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:45221
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:45221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24480
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:04.596355 24480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:04.596596 24480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:04.600994 24490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:04.601006 24492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:04.601148 24480 server_base.cc:1034] running on GCE node
W20260808 17:54:04.600997 24488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:04.601472 24480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:04.601745 24480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:04.602891 24480 hybrid_clock.cc:648] HybridClock initialized: now 1786211644602875 us; error 27 us; skew 500 ppm
Aug 08 17:54:04 dist-test-slave-bndk krb5kdc[24464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211644, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:04.605198 24480 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:54:04.605609 24480 webserver.cc:460] Webserver started at http://127.28.213.190:37063/ using document root <none> and password file <none>
I20260808 17:54:04.605796 24480 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:04.605841 24480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:04.605971 24480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:04.606968 24480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "4d2b53d2282148a09ac60779833ddd95"
format_stamp: "Formatted at 2026-08-08 17:54:04 on dist-test-slave-bndk"
server_key: "adfb403e10b8a29b39c92b7557cb3521"
server_key_iv: "1887dcf2f4f64bc16b9b5e357fdf7247"
server_key_version: "encryptionkey@0"
I20260808 17:54:04.607293 24480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "4d2b53d2282148a09ac60779833ddd95"
format_stamp: "Formatted at 2026-08-08 17:54:04 on dist-test-slave-bndk"
server_key: "adfb403e10b8a29b39c92b7557cb3521"
server_key_iv: "1887dcf2f4f64bc16b9b5e357fdf7247"
server_key_version: "encryptionkey@0"
I20260808 17:54:04.608512 24480 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:54:04.609162 24505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:04.609321 24480 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:04.609403 24480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "4d2b53d2282148a09ac60779833ddd95"
format_stamp: "Formatted at 2026-08-08 17:54:04 on dist-test-slave-bndk"
server_key: "adfb403e10b8a29b39c92b7557cb3521"
server_key_iv: "1887dcf2f4f64bc16b9b5e357fdf7247"
server_key_version: "encryptionkey@0"
I20260808 17:54:04.609468 24480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:04.621920 24480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:04.623867 24480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:04.624001 24480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:04.627818 24480 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:45221
I20260808 17:54:04.627854 24576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:45221 every 8 connection(s)
I20260808 17:54:04.628206 24480 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:04.628996 24578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:04.629079 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 24480
I20260808 17:54:04.629187 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:04.629423 29526 external_mini_cluster.cc:1428] Setting key 87d16a143a9288b113e3015f7de11f0b
I20260808 17:54:04.632170 24578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95: Bootstrap starting.
I20260808 17:54:04.632810 24578 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:04.633069 24578 log.cc:824] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:04.633744 24578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95: No bootstrap required, opened a new log
I20260808 17:54:04.635584 24578 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d2b53d2282148a09ac60779833ddd95" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 45221 } }
Aug 08 17:54:04 dist-test-slave-bndk krb5kdc[24464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211644, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:04.635711 24578 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:04.635746 24578 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2b53d2282148a09ac60779833ddd95, State: Initialized, Role: FOLLOWER
I20260808 17:54:04.635886 24578 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d2b53d2282148a09ac60779833ddd95" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 45221 } }
I20260808 17:54:04.635973 24578 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:04.636016 24578 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:04.636063 24578 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:04.636588 24578 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d2b53d2282148a09ac60779833ddd95" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 45221 } }
I20260808 17:54:04.636678 24578 leader_election.cc:302] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d2b53d2282148a09ac60779833ddd95; no voters:
I20260808 17:54:04.636830 24578 leader_election.cc:288] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:04.636873 24590 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:04.637022 24590 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95 [term 1 LEADER]: Becoming Leader. State: Replica: 4d2b53d2282148a09ac60779833ddd95, State: Running, Role: LEADER
I20260808 17:54:04.637089 24578 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:04.637115 24590 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d2b53d2282148a09ac60779833ddd95" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 45221 } }
I20260808 17:54:04.637508 24591 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d2b53d2282148a09ac60779833ddd95. Latest consensus state: current_term: 1 leader_uuid: "4d2b53d2282148a09ac60779833ddd95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d2b53d2282148a09ac60779833ddd95" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 45221 } } }
I20260808 17:54:04.637593 24591 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:04.637799 24603 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:04.637776 24592 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d2b53d2282148a09ac60779833ddd95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d2b53d2282148a09ac60779833ddd95" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 45221 } } }
I20260808 17:54:04.637862 24592 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:04.638273 24603 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:04.639873 24603 catalog_manager.cc:1347] Generated new cluster ID: f7a5d317954f4f869111dcefa7d539d7
I20260808 17:54:04.639923 24603 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:04.640471 24586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:04.629883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37780 (local address 127.28.213.190:45221)
0808 17:54:04.630055 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:04.630064 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:04.630097 (+ 33us) server_negotiation.cc:407] Connection header received
0808 17:54:04.630555 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:04.630564 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:04.630626 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:04.630773 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:04.631344 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:04.632660 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:04.633491 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:04.634054 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:04.634158 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:04.636259 (+ 2101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:04.636263 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:04.636263 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:04.636272 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:04.638631 (+ 2359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:04.639040 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:04.639042 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:04.639043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:04.639119 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:04.639316 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:04.639317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:04.639317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:04.639597 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:04.639729 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:04.640143 (+ 414us) server_negotiation.cc:299] Negotiation successful
0808 17:54:04.640276 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":75,"threads_started":1}
I20260808 17:54:04.649003 24603 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:04.649703 24603 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:04.661185 24603 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95: Generated new TSK 0
I20260808 17:54:04.661367 24603 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
I20260808 17:54:04.687646 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:45221
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:44383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:04.766453 24621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:04.766641 24621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:04.766670 24621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:04.767751 24621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:04.767791 24621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:04.767824 24621 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:54:04.769232 24621 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:44383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:45221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24621
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:04.769454 24621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:04.769667 24621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:04.774296 24632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:04.774387 24621 server_base.cc:1034] running on GCE node
W20260808 17:54:04.774299 24629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:04.774294 24630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:04.774648 24621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:04.774873 24621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:04.776007 24621 hybrid_clock.cc:648] HybridClock initialized: now 1786211644775994 us; error 29 us; skew 500 ppm
Aug 08 17:54:04 dist-test-slave-bndk krb5kdc[24464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211644, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:04.778353 24621 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:54:04.778753 24621 webserver.cc:460] Webserver started at http://127.28.213.129:36857/ using document root <none> and password file <none>
I20260808 17:54:04.778954 24621 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:04.779000 24621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:04.779121 24621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:04.780153 24621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "d341928d715b435b9230af0c2fdafc0b"
format_stamp: "Formatted at 2026-08-08 17:54:04 on dist-test-slave-bndk"
server_key: "26e2ec41ca78fcf75cbe1d3780ca3c99"
server_key_iv: "88adc46eedd04e03cbc9f4105d54172b"
server_key_version: "encryptionkey@0"
I20260808 17:54:04.780478 24621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "d341928d715b435b9230af0c2fdafc0b"
format_stamp: "Formatted at 2026-08-08 17:54:04 on dist-test-slave-bndk"
server_key: "26e2ec41ca78fcf75cbe1d3780ca3c99"
server_key_iv: "88adc46eedd04e03cbc9f4105d54172b"
server_key_version: "encryptionkey@0"
I20260808 17:54:04.781697 24621 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:54:04.782320 24642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:04.782470 24621 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:54:04.782549 24621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "d341928d715b435b9230af0c2fdafc0b"
format_stamp: "Formatted at 2026-08-08 17:54:04 on dist-test-slave-bndk"
server_key: "26e2ec41ca78fcf75cbe1d3780ca3c99"
server_key_iv: "88adc46eedd04e03cbc9f4105d54172b"
server_key_version: "encryptionkey@0"
I20260808 17:54:04.782608 24621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:04.807515 24621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:04.809060 24621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:04.809178 24621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:04.809386 24621 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:54:04.809652 24621 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:54:04.809686 24621 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:04.809712 24621 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:54:04.809736 24621 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:04.815030 24621 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:35281
I20260808 17:54:04.815088 24810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:35281 every 8 connection(s)
I20260808 17:54:04.815337 24621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
Aug 08 17:54:04 dist-test-slave-bndk krb5kdc[24464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211644, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:04.822252 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 24621
I20260808 17:54:04.822364 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:54:04.822552 29526 external_mini_cluster.cc:1428] Setting key 0cc8c66be052d6dd7694371daae016b3
I20260808 17:54:04.823441 24586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:04.815911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:60495 (local address 127.28.213.190:45221)
0808 17:54:04.815961 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:04.815963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:04.816145 (+ 182us) server_negotiation.cc:407] Connection header received
0808 17:54:04.816593 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:04.816594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:04.816607 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:04.816654 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:04.817566 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:04.818055 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:04.818978 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:04.819178 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:04.819232 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:04.821090 (+ 1858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:04.821092 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:04.821092 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:04.821099 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:04.822194 (+ 1095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:04.822602 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:04.822604 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:04.822604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:04.822656 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:04.822874 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:04.822875 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:04.822876 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:04.822975 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:04.823029 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:04.823272 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 17:54:04.823353 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:54:04.823585 24814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:04.815893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:45221 (local address 127.28.213.129:60495)
0808 17:54:04.816039 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:04.816071 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:04.816504 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:04.816726 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:04.816730 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:04.817288 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:04.817472 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:04.817477 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:04.818136 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:04.818137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:04.818890 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:04.818893 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:04.819244 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:04.819245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:04.819354 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:04.819733 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:04.819741 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:04.821009 (+ 1268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:04.822266 (+ 1257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:04.822273 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:04.822275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:04.822536 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:04.822709 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:04.822710 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:04.822710 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:04.822812 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:04.823029 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:04.823035 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:04.823158 (+ 123us) client_negotiation.cc:769] Sending connection context
0808 17:54:04.823240 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 17:54:04.823391 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":70,"threads_started":1}
I20260808 17:54:04.824177 24811 heartbeater.cc:347] Connected to a master server at 127.28.213.190:45221
I20260808 17:54:04.824250 24811 heartbeater.cc:464] Registering TS with master...
I20260808 17:54:04.824396 24811 heartbeater.cc:511] Master 127.28.213.190:45221 requested a full tablet report, sending...
I20260808 17:54:04.824899 24528 ts_manager.cc:194] Registered new tserver with Master: d341928d715b435b9230af0c2fdafc0b (127.28.213.129:35281)
I20260808 17:54:04.825528 24528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:60495
WARNING: no policy specified for kudu/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
I20260808 17:54:04.845649 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:45221
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:44383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:04.923478 24817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:04.923658 24817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:04.923679 24817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:04.924722 24817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:04.924753 24817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:04.924777 24817 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:54:04.926182 24817 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:44383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:45221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:04.926357 24817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:04.926528 24817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:04.931030 24825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:04.931037 24826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:04.931073 24828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:04.931087 24817 server_base.cc:1034] running on GCE node
I20260808 17:54:04.931424 24817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:04.931630 24817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:04.932760 24817 hybrid_clock.cc:648] HybridClock initialized: now 1786211644932753 us; error 31 us; skew 500 ppm
Aug 08 17:54:04 dist-test-slave-bndk krb5kdc[24464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211644, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:04.934966 24817 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:54:04.935348 24817 webserver.cc:460] Webserver started at http://127.28.213.130:39201/ using document root <none> and password file <none>
I20260808 17:54:04.935534 24817 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:04.935575 24817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:04.935690 24817 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:04.936621 24817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "8c3df7dc8aca4a93a46887c47fb8197c"
format_stamp: "Formatted at 2026-08-08 17:54:04 on dist-test-slave-bndk"
server_key: "383f6c605f923259bf7d2be8ef379545"
server_key_iv: "4e96ea2ff03bae017a718774f39764a1"
server_key_version: "encryptionkey@0"
I20260808 17:54:04.936967 24817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "8c3df7dc8aca4a93a46887c47fb8197c"
format_stamp: "Formatted at 2026-08-08 17:54:04 on dist-test-slave-bndk"
server_key: "383f6c605f923259bf7d2be8ef379545"
server_key_iv: "4e96ea2ff03bae017a718774f39764a1"
server_key_version: "encryptionkey@0"
I20260808 17:54:04.938292 24817 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:54:04.939002 24840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:04.939157 24817 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:04.939236 24817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "8c3df7dc8aca4a93a46887c47fb8197c"
format_stamp: "Formatted at 2026-08-08 17:54:04 on dist-test-slave-bndk"
server_key: "383f6c605f923259bf7d2be8ef379545"
server_key_iv: "4e96ea2ff03bae017a718774f39764a1"
server_key_version: "encryptionkey@0"
I20260808 17:54:04.939287 24817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:04.946274 24817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:04.947762 24817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:04.947858 24817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:04.948012 24817 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:54:04.948232 24817 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:54:04.948261 24817 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:04.948278 24817 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:54:04.948295 24817 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:04.953656 24817 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:44505
I20260808 17:54:04.953691 24998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:44505 every 8 connection(s)
I20260808 17:54:04.953938 24817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
Aug 08 17:54:04 dist-test-slave-bndk krb5kdc[24464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211644, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:04.959748 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 24817
I20260808 17:54:04.959864 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:54:04.960057 29526 external_mini_cluster.cc:1428] Setting key 1215464a75b81873955701c2c51dbf6f
I20260808 17:54:04.962010 24586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:04.954535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:58265 (local address 127.28.213.190:45221)
0808 17:54:04.954585 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:04.954587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:04.954757 (+ 170us) server_negotiation.cc:407] Connection header received
0808 17:54:04.955158 (+ 401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:04.955159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:04.955168 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:04.955218 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:04.956011 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:04.956482 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:04.957385 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:04.957569 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:04.957617 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:04.959416 (+ 1799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:04.959418 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:04.959419 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:04.959425 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:04.960753 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:04.961165 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:04.961165 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:04.961166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:04.961212 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:04.961489 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:04.961490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:04.961490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:04.961585 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:04.961630 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:04.961893 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 17:54:04.961949 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:54:04.962214 25001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:04.954489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:45221 (local address 127.28.213.130:58265)
0808 17:54:04.954647 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:04.954684 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:04.955090 (+ 406us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:04.955270 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:04.955273 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:04.955772 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:04.955950 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:04.955954 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:04.956539 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:04.956540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:04.957327 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:04.957330 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:04.957623 (+ 293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:04.957623 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:04.957716 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:04.958112 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:04.958120 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:04.959336 (+ 1216us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:04.960824 (+ 1488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:04.960831 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:04.960833 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:04.961099 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:04.961291 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:04.961291 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:04.961292 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:04.961437 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:04.961635 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:04.961641 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:04.961778 (+ 137us) client_negotiation.cc:769] Sending connection context
0808 17:54:04.961879 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 17:54:04.962019 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":89,"threads_started":1}
I20260808 17:54:04.962664 24999 heartbeater.cc:347] Connected to a master server at 127.28.213.190:45221
I20260808 17:54:04.962759 24999 heartbeater.cc:464] Registering TS with master...
I20260808 17:54:04.962930 24999 heartbeater.cc:511] Master 127.28.213.190:45221 requested a full tablet report, sending...
I20260808 17:54:04.963243 24528 ts_manager.cc:194] Registered new tserver with Master: 8c3df7dc8aca4a93a46887c47fb8197c (127.28.213.130:44505)
I20260808 17:54:04.963594 24528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:58265
WARNING: no policy specified for kudu/127.28.213.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
I20260808 17:54:04.983800 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:45221
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:44383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:05.061916 25004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:05.062100 25004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:05.062132 25004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:05.063622 25004 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:05.063663 25004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:05.063699 25004 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:54:05.065099 25004 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:44383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:45221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25004
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:05.065330 25004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:05.065538 25004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:05.070037 25010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:05.070066 25004 server_base.cc:1034] running on GCE node
W20260808 17:54:05.070034 25013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:05.070032 25011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:05.070448 25004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:05.070669 25004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:05.071815 25004 hybrid_clock.cc:648] HybridClock initialized: now 1786211645071806 us; error 27 us; skew 500 ppm
Aug 08 17:54:05 dist-test-slave-bndk krb5kdc[24464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211645, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:05.074150 25004 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:54:05.074553 25004 webserver.cc:460] Webserver started at http://127.28.213.131:33757/ using document root <none> and password file <none>
I20260808 17:54:05.074755 25004 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:05.074802 25004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:05.074926 25004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:05.075881 25004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "e16d2df1db2e46f7a843f5a85e164263"
format_stamp: "Formatted at 2026-08-08 17:54:05 on dist-test-slave-bndk"
server_key: "8bfcf6d751d3612f7b74db16c679ccaa"
server_key_iv: "9bad56f0ca27b746f3519c76706f121b"
server_key_version: "encryptionkey@0"
I20260808 17:54:05.076205 25004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "e16d2df1db2e46f7a843f5a85e164263"
format_stamp: "Formatted at 2026-08-08 17:54:05 on dist-test-slave-bndk"
server_key: "8bfcf6d751d3612f7b74db16c679ccaa"
server_key_iv: "9bad56f0ca27b746f3519c76706f121b"
server_key_version: "encryptionkey@0"
I20260808 17:54:05.077423 25004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:54:05.078058 25020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:05.078199 25004 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:05.078269 25004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "e16d2df1db2e46f7a843f5a85e164263"
format_stamp: "Formatted at 2026-08-08 17:54:05 on dist-test-slave-bndk"
server_key: "8bfcf6d751d3612f7b74db16c679ccaa"
server_key_iv: "9bad56f0ca27b746f3519c76706f121b"
server_key_version: "encryptionkey@0"
I20260808 17:54:05.078328 25004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:05.099885 25004 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:05.101524 25004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:05.101649 25004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:05.101845 25004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:54:05.102125 25004 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:54:05.102159 25004 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:05.102185 25004 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:54:05.102202 25004 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:05.107509 25004 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:35643
I20260808 17:54:05.107566 25194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:35643 every 8 connection(s)
I20260808 17:54:05.107827 25004 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:54:05.108023 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 25004
I20260808 17:54:05.108153 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:54:05.108388 29526 external_mini_cluster.cc:1428] Setting key a1d6dcfd7bf94b05515ef13cec53e680
Aug 08 17:54:05 dist-test-slave-bndk krb5kdc[24464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211645, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:05.116235 24586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.108590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:56521 (local address 127.28.213.190:45221)
0808 17:54:05.108653 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:05.108654 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:05.108806 (+ 152us) server_negotiation.cc:407] Connection header received
0808 17:54:05.109419 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:05.109420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:05.109431 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:05.109465 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:05.110308 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.110790 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.111717 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.111895 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.111937 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:05.113930 (+ 1993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:05.113932 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:05.113932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:05.113939 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:05.115025 (+ 1086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:05.115370 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:05.115371 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:05.115372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:05.115428 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:05.115634 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:05.115635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:05.115635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:05.115745 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:05.115801 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:05.116053 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 17:54:05.116146 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 17:54:05.116357 25199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.108499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:45221 (local address 127.28.213.131:56521)
0808 17:54:05.108688 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:05.108733 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:05.109334 (+ 601us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:05.109523 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:05.109526 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:05.110071 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:05.110245 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:05.110250 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.110850 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.110851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:05.111662 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:05.111664 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.111945 (+ 281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.111946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:05.112057 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:05.112508 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:05.112516 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:05.113833 (+ 1317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:05.115094 (+ 1261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:05.115100 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:05.115102 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:05.115296 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:05.115482 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:05.115483 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:05.115483 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:05.115578 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:05.115799 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:05.115805 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:05.115934 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 17:54:05.116018 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 17:54:05.116158 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":97,"threads_started":1}
I20260808 17:54:05.116705 25196 heartbeater.cc:347] Connected to a master server at 127.28.213.190:45221
I20260808 17:54:05.116782 25196 heartbeater.cc:464] Registering TS with master...
I20260808 17:54:05.116941 25196 heartbeater.cc:511] Master 127.28.213.190:45221 requested a full tablet report, sending...
I20260808 17:54:05.117278 24528 ts_manager.cc:194] Registered new tserver with Master: e16d2df1db2e46f7a843f5a85e164263 (127.28.213.131:35643)
I20260808 17:54:05.117645 24528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:56521
I20260808 17:54:05.120080 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:54:05.126556 24586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.121357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37792 (local address 127.28.213.190:45221)
0808 17:54:05.121393 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:05.121395 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:05.121552 (+ 157us) server_negotiation.cc:407] Connection header received
0808 17:54:05.121588 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:05.121589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:05.121597 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:05.121636 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:05.122117 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.122561 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.123222 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.123393 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.123433 (+ 40us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:05.124535 (+ 1102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:05.124536 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:05.124537 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:05.124541 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:05.125638 (+ 1097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:05.125989 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:05.125989 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:05.125989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:05.126035 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:05.126177 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:05.126177 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:05.126177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:05.126282 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:05.126353 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:05.126437 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 17:54:05.126482 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 17:54:05.131181 24528 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37792:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:54:05.132678 24528 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:54:05.138832 25212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.135085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49922 (local address 127.28.213.130:44505)
0808 17:54:05.135242 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:05.135247 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:05.135257 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:54:05.135297 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:05.135299 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:05.135316 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:05.135393 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:05.135493 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.136308 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.137707 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.138457 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.138523 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:05.138578 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:05.138719 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 17:54:05.138761 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":77,"threads_started":1}
I20260808 17:54:05.138825 25208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.134755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:44505 (local address 127.0.0.1:49922)
0808 17:54:05.135029 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:05.135039 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:05.135087 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:05.135403 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:05.135404 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:05.135405 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:05.135435 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:05.135436 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.136397 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.136398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:05.137636 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:05.137639 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.138529 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.138530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:05.138621 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:05.138635 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 17:54:05.138697 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 17:54:05.138747 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":4,"thread_start_us":54,"threads_started":1}
I20260808 17:54:05.139328 25207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.134755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:35281 (local address 127.0.0.1:47934)
0808 17:54:05.134901 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:05.134936 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:05.134999 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:05.135315 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:05.135318 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:05.135320 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:05.135390 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:05.135392 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.136720 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.136721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:05.137937 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:05.137940 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.139094 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.139095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:05.139155 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:05.139160 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:54:05.139225 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 17:54:05.139262 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":1,"thread_start_us":49,"threads_started":1}
I20260808 17:54:05.139361 25210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.134878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47934 (local address 127.28.213.129:35281)
0808 17:54:05.135173 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:05.135177 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:05.135184 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:54:05.135215 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:05.135217 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:05.135229 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:05.135297 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:05.135527 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.136578 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.138010 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.139027 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.139087 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:05.139142 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:05.139240 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 17:54:05.139281 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":69,"threads_started":1}
I20260808 17:54:05.139529 24909 tablet_service.cc:1467] Processing CreateTablet for tablet 8fa8ddba79d444b3b60f12812e5dadd2 (DEFAULT_TABLE table=test-table [id=adc7a6afe2414c21b76633bec3e40575]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:54:05.139849 24909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fa8ddba79d444b3b60f12812e5dadd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:05.139991 25211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.134945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:35643 (local address 127.0.0.1:43700)
0808 17:54:05.135469 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:05.135479 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:05.135527 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:05.135799 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:05.135800 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:05.135802 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:05.135842 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:05.135843 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.136968 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.136969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:05.138023 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:05.138026 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.139167 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.139169 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:05.139243 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:05.139248 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:54:05.139287 (+ 39us) client_negotiation.cc:240] Negotiation successful
0808 17:54:05.139326 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":50,"threads_started":1}
I20260808 17:54:05.139880 25213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.135259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43700 (local address 127.28.213.131:35643)
0808 17:54:05.135425 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:05.135429 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:05.135600 (+ 171us) server_negotiation.cc:407] Connection header received
0808 17:54:05.135640 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:05.135642 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:05.135657 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:05.135704 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:05.135915 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.136887 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.138101 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.138792 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.138861 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:05.139739 (+ 878us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:05.139767 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 17:54:05.139807 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":77,"threads_started":1}
I20260808 17:54:05.140103 24710 tablet_service.cc:1467] Processing CreateTablet for tablet 8fa8ddba79d444b3b60f12812e5dadd2 (DEFAULT_TABLE table=test-table [id=adc7a6afe2414c21b76633bec3e40575]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:54:05.140421 24710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fa8ddba79d444b3b60f12812e5dadd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:05.140933 25099 tablet_service.cc:1467] Processing CreateTablet for tablet 8fa8ddba79d444b3b60f12812e5dadd2 (DEFAULT_TABLE table=test-table [id=adc7a6afe2414c21b76633bec3e40575]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:54:05.141260 25099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fa8ddba79d444b3b60f12812e5dadd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:05.142652 25214 tablet_bootstrap.cc:492] T 8fa8ddba79d444b3b60f12812e5dadd2 P 8c3df7dc8aca4a93a46887c47fb8197c: Bootstrap starting.
I20260808 17:54:05.143304 25214 tablet_bootstrap.cc:654] T 8fa8ddba79d444b3b60f12812e5dadd2 P 8c3df7dc8aca4a93a46887c47fb8197c: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:05.143704 25214 log.cc:824] T 8fa8ddba79d444b3b60f12812e5dadd2 P 8c3df7dc8aca4a93a46887c47fb8197c: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:05.144007 25217 tablet_bootstrap.cc:492] T 8fa8ddba79d444b3b60f12812e5dadd2 P d341928d715b435b9230af0c2fdafc0b: Bootstrap starting.
I20260808 17:54:05.144304 25221 tablet_bootstrap.cc:492] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263: Bootstrap starting.
I20260808 17:54:05.144596 25217 tablet_bootstrap.cc:654] T 8fa8ddba79d444b3b60f12812e5dadd2 P d341928d715b435b9230af0c2fdafc0b: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:05.144807 25221 tablet_bootstrap.cc:654] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:05.145061 25217 log.cc:824] T 8fa8ddba79d444b3b60f12812e5dadd2 P d341928d715b435b9230af0c2fdafc0b: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:05.145193 25221 log.cc:824] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:05.145848 25214 tablet_bootstrap.cc:492] T 8fa8ddba79d444b3b60f12812e5dadd2 P 8c3df7dc8aca4a93a46887c47fb8197c: No bootstrap required, opened a new log
I20260808 17:54:05.145917 25214 ts_tablet_manager.cc:1397] T 8fa8ddba79d444b3b60f12812e5dadd2 P 8c3df7dc8aca4a93a46887c47fb8197c: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 17:54:05.146061 25221 tablet_bootstrap.cc:492] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263: No bootstrap required, opened a new log
I20260808 17:54:05.146068 25217 tablet_bootstrap.cc:492] T 8fa8ddba79d444b3b60f12812e5dadd2 P d341928d715b435b9230af0c2fdafc0b: No bootstrap required, opened a new log
I20260808 17:54:05.146124 25221 ts_tablet_manager.cc:1397] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:54:05.146126 25217 ts_tablet_manager.cc:1397] T 8fa8ddba79d444b3b60f12812e5dadd2 P d341928d715b435b9230af0c2fdafc0b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 17:54:05.147377 25217 raft_consensus.cc:348] T 8fa8ddba79d444b3b60f12812e5dadd2 P d341928d715b435b9230af0c2fdafc0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d341928d715b435b9230af0c2fdafc0b" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 35281 } } peers { permanent_uuid: "8c3df7dc8aca4a93a46887c47fb8197c" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44505 } } peers { permanent_uuid: "e16d2df1db2e46f7a843f5a85e164263" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 35643 } }
I20260808 17:54:05.147511 25217 raft_consensus.cc:374] T 8fa8ddba79d444b3b60f12812e5dadd2 P d341928d715b435b9230af0c2fdafc0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:05.147543 25217 raft_consensus.cc:729] T 8fa8ddba79d444b3b60f12812e5dadd2 P d341928d715b435b9230af0c2fdafc0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d341928d715b435b9230af0c2fdafc0b, State: Initialized, Role: FOLLOWER
I20260808 17:54:05.147651 25217 consensus_queue.cc:260] T 8fa8ddba79d444b3b60f12812e5dadd2 P d341928d715b435b9230af0c2fdafc0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d341928d715b435b9230af0c2fdafc0b" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 35281 } } peers { permanent_uuid: "8c3df7dc8aca4a93a46887c47fb8197c" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44505 } } peers { permanent_uuid: "e16d2df1db2e46f7a843f5a85e164263" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 35643 } }
I20260808 17:54:05.147754 25214 raft_consensus.cc:348] T 8fa8ddba79d444b3b60f12812e5dadd2 P 8c3df7dc8aca4a93a46887c47fb8197c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d341928d715b435b9230af0c2fdafc0b" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 35281 } } peers { permanent_uuid: "8c3df7dc8aca4a93a46887c47fb8197c" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44505 } } peers { permanent_uuid: "e16d2df1db2e46f7a843f5a85e164263" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 35643 } }
I20260808 17:54:05.147918 25217 ts_tablet_manager.cc:1428] T 8fa8ddba79d444b3b60f12812e5dadd2 P d341928d715b435b9230af0c2fdafc0b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 17:54:05.147927 25214 raft_consensus.cc:374] T 8fa8ddba79d444b3b60f12812e5dadd2 P 8c3df7dc8aca4a93a46887c47fb8197c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:05.147964 25214 raft_consensus.cc:729] T 8fa8ddba79d444b3b60f12812e5dadd2 P 8c3df7dc8aca4a93a46887c47fb8197c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3df7dc8aca4a93a46887c47fb8197c, State: Initialized, Role: FOLLOWER
I20260808 17:54:05.147855 25221 raft_consensus.cc:348] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d341928d715b435b9230af0c2fdafc0b" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 35281 } } peers { permanent_uuid: "8c3df7dc8aca4a93a46887c47fb8197c" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44505 } } peers { permanent_uuid: "e16d2df1db2e46f7a843f5a85e164263" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 35643 } }
I20260808 17:54:05.148008 25221 raft_consensus.cc:374] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:05.148047 24811 heartbeater.cc:503] Master 127.28.213.190:45221 was elected leader, sending a full tablet report...
I20260808 17:54:05.148048 25221 raft_consensus.cc:729] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e16d2df1db2e46f7a843f5a85e164263, State: Initialized, Role: FOLLOWER
I20260808 17:54:05.148078 25214 consensus_queue.cc:260] T 8fa8ddba79d444b3b60f12812e5dadd2 P 8c3df7dc8aca4a93a46887c47fb8197c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d341928d715b435b9230af0c2fdafc0b" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 35281 } } peers { permanent_uuid: "8c3df7dc8aca4a93a46887c47fb8197c" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44505 } } peers { permanent_uuid: "e16d2df1db2e46f7a843f5a85e164263" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 35643 } }
I20260808 17:54:05.148159 25221 consensus_queue.cc:260] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d341928d715b435b9230af0c2fdafc0b" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 35281 } } peers { permanent_uuid: "8c3df7dc8aca4a93a46887c47fb8197c" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44505 } } peers { permanent_uuid: "e16d2df1db2e46f7a843f5a85e164263" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 35643 } }
I20260808 17:54:05.148343 25214 ts_tablet_manager.cc:1428] T 8fa8ddba79d444b3b60f12812e5dadd2 P 8c3df7dc8aca4a93a46887c47fb8197c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:54:05.148393 25221 ts_tablet_manager.cc:1428] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:54:05.148398 24999 heartbeater.cc:503] Master 127.28.213.190:45221 was elected leader, sending a full tablet report...
I20260808 17:54:05.148501 25196 heartbeater.cc:503] Master 127.28.213.190:45221 was elected leader, sending a full tablet report...
W20260808 17:54:05.204409 25000 tablet.cc:2369] T 8fa8ddba79d444b3b60f12812e5dadd2 P 8c3df7dc8aca4a93a46887c47fb8197c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:54:05.315999 24812 tablet.cc:2369] T 8fa8ddba79d444b3b60f12812e5dadd2 P d341928d715b435b9230af0c2fdafc0b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:54:05.354787 25228 raft_consensus.cc:482] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:54:05.354918 25228 raft_consensus.cc:504] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d341928d715b435b9230af0c2fdafc0b" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 35281 } } peers { permanent_uuid: "8c3df7dc8aca4a93a46887c47fb8197c" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44505 } } peers { permanent_uuid: "e16d2df1db2e46f7a843f5a85e164263" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 35643 } }
I20260808 17:54:05.355589 25228 leader_election.cc:288] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d341928d715b435b9230af0c2fdafc0b (127.28.213.129:35281), 8c3df7dc8aca4a93a46887c47fb8197c (127.28.213.130:44505)
W20260808 17:54:05.358583 25197 tablet.cc:2369] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:54:05.358894 25212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.355639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:52869 (local address 127.28.213.130:44505)
0808 17:54:05.355693 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:05.355695 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:05.355773 (+ 78us) server_negotiation.cc:407] Connection header received
0808 17:54:05.355834 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:05.355835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:05.355843 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:05.355892 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:05.356022 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.356713 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.358091 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.358472 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.358537 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:05.358546 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:05.358775 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 17:54:05.358818 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:54:05.359126 25229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.355455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:44505 (local address 127.28.213.131:52869)
0808 17:54:05.355724 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:05.355733 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:05.355782 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:05.355899 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:05.355900 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:05.355901 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:05.355967 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:05.355968 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.356796 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.356797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:05.357983 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:05.357986 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.358578 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.358579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:05.358688 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:05.358693 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:54:05.358971 (+ 278us) client_negotiation.cc:240] Negotiation successful
0808 17:54:05.359018 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":36,"thread_start_us":80,"threads_started":1}
I20260808 17:54:05.359284 25210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.355576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:39755 (local address 127.28.213.129:35281)
0808 17:54:05.355629 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:05.355631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:05.355641 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:54:05.355673 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:05.355674 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:05.355684 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:05.355752 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:05.355932 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.356656 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.358059 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.358636 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.358713 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:05.358721 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:05.359159 (+ 438us) server_negotiation.cc:299] Negotiation successful
0808 17:54:05.359201 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:54:05.359521 25199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.355453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:35281 (local address 127.28.213.131:39755)
0808 17:54:05.355508 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:05.355519 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:05.355563 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:05.355806 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:05.355808 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:05.355810 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:05.355869 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:05.355871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.356730 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.356731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:05.357983 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:05.357986 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.358815 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.358816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:05.358906 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:05.358910 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:54:05.358961 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 17:54:05.359000 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":11}
I20260808 17:54:05.359508 24934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fa8ddba79d444b3b60f12812e5dadd2" candidate_uuid: "e16d2df1db2e46f7a843f5a85e164263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3df7dc8aca4a93a46887c47fb8197c" is_pre_election: true
I20260808 17:54:05.359660 24934 raft_consensus.cc:2454] T 8fa8ddba79d444b3b60f12812e5dadd2 P 8c3df7dc8aca4a93a46887c47fb8197c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e16d2df1db2e46f7a843f5a85e164263 in term 0.
I20260808 17:54:05.359877 25022 leader_election.cc:302] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3df7dc8aca4a93a46887c47fb8197c, e16d2df1db2e46f7a843f5a85e164263; no voters:
I20260808 17:54:05.359848 24738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fa8ddba79d444b3b60f12812e5dadd2" candidate_uuid: "e16d2df1db2e46f7a843f5a85e164263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d341928d715b435b9230af0c2fdafc0b" is_pre_election: true
I20260808 17:54:05.360001 24738 raft_consensus.cc:2454] T 8fa8ddba79d444b3b60f12812e5dadd2 P d341928d715b435b9230af0c2fdafc0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e16d2df1db2e46f7a843f5a85e164263 in term 0.
I20260808 17:54:05.360031 25228 raft_consensus.cc:2781] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:54:05.360082 25228 raft_consensus.cc:482] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:54:05.360116 25228 raft_consensus.cc:3037] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:05.360802 25228 raft_consensus.cc:504] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d341928d715b435b9230af0c2fdafc0b" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 35281 } } peers { permanent_uuid: "8c3df7dc8aca4a93a46887c47fb8197c" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44505 } } peers { permanent_uuid: "e16d2df1db2e46f7a843f5a85e164263" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 35643 } }
I20260808 17:54:05.360925 25228 leader_election.cc:288] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [CANDIDATE]: Term 1 election: Requested vote from peers d341928d715b435b9230af0c2fdafc0b (127.28.213.129:35281), 8c3df7dc8aca4a93a46887c47fb8197c (127.28.213.130:44505)
I20260808 17:54:05.361054 24934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fa8ddba79d444b3b60f12812e5dadd2" candidate_uuid: "e16d2df1db2e46f7a843f5a85e164263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3df7dc8aca4a93a46887c47fb8197c"
I20260808 17:54:05.361089 24738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fa8ddba79d444b3b60f12812e5dadd2" candidate_uuid: "e16d2df1db2e46f7a843f5a85e164263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d341928d715b435b9230af0c2fdafc0b"
I20260808 17:54:05.361123 24934 raft_consensus.cc:3037] T 8fa8ddba79d444b3b60f12812e5dadd2 P 8c3df7dc8aca4a93a46887c47fb8197c [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:05.361177 24738 raft_consensus.cc:3037] T 8fa8ddba79d444b3b60f12812e5dadd2 P d341928d715b435b9230af0c2fdafc0b [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:05.361940 24934 raft_consensus.cc:2454] T 8fa8ddba79d444b3b60f12812e5dadd2 P 8c3df7dc8aca4a93a46887c47fb8197c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e16d2df1db2e46f7a843f5a85e164263 in term 1.
I20260808 17:54:05.362071 24738 raft_consensus.cc:2454] T 8fa8ddba79d444b3b60f12812e5dadd2 P d341928d715b435b9230af0c2fdafc0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e16d2df1db2e46f7a843f5a85e164263 in term 1.
I20260808 17:54:05.362077 25022 leader_election.cc:302] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3df7dc8aca4a93a46887c47fb8197c, e16d2df1db2e46f7a843f5a85e164263; no voters:
I20260808 17:54:05.362149 25228 raft_consensus.cc:2781] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:05.362270 25228 raft_consensus.cc:686] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [term 1 LEADER]: Becoming Leader. State: Replica: e16d2df1db2e46f7a843f5a85e164263, State: Running, Role: LEADER
I20260808 17:54:05.362344 25228 consensus_queue.cc:237] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d341928d715b435b9230af0c2fdafc0b" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 35281 } } peers { permanent_uuid: "8c3df7dc8aca4a93a46887c47fb8197c" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44505 } } peers { permanent_uuid: "e16d2df1db2e46f7a843f5a85e164263" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 35643 } }
I20260808 17:54:05.363133 24527 catalog_manager.cc:5495] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 reported cstate change: term changed from 0 to 1, leader changed from <none> to e16d2df1db2e46f7a843f5a85e164263 (127.28.213.131). New cstate: current_term: 1 leader_uuid: "e16d2df1db2e46f7a843f5a85e164263" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d341928d715b435b9230af0c2fdafc0b" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 35281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3df7dc8aca4a93a46887c47fb8197c" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e16d2df1db2e46f7a843f5a85e164263" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 35643 } health_report { overall_health: HEALTHY } } }
I20260808 17:54:05.421902 25213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.419450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43706 (local address 127.28.213.131:35643)
0808 17:54:05.419493 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:05.419496 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:05.419504 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:54:05.419577 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:05.419578 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:05.419595 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:05.419654 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:54:05.419781 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.420279 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.420999 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.421197 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.421275 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:05.421577 (+ 302us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:54:05.421674 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:54:05.421759 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:05.421805 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 17:54:05.421815 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:54:05.423647 24738 raft_consensus.cc:1261] T 8fa8ddba79d444b3b60f12812e5dadd2 P d341928d715b435b9230af0c2fdafc0b [term 1 FOLLOWER]: Refusing update from remote peer e16d2df1db2e46f7a843f5a85e164263: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:54:05.423647 24934 raft_consensus.cc:1261] T 8fa8ddba79d444b3b60f12812e5dadd2 P 8c3df7dc8aca4a93a46887c47fb8197c [term 1 FOLLOWER]: Refusing update from remote peer e16d2df1db2e46f7a843f5a85e164263: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:54:05.424041 25228 consensus_queue.cc:1035] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3df7dc8aca4a93a46887c47fb8197c" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 44505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:54:05.424191 25233 consensus_queue.cc:1035] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d341928d715b435b9230af0c2fdafc0b" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:54:05.426532 25239 mvcc.cc:205] Tried to move back new op lower bound from 7316322899652497408 to 7316322899404795904. Current Snapshot: MvccSnapshot[applied={T|T < 7316322899652497408}]
I20260808 17:54:05.426887 25240 mvcc.cc:205] Tried to move back new op lower bound from 7316322899652497408 to 7316322899404795904. Current Snapshot: MvccSnapshot[applied={T|T < 7316322899652497408}]
I20260808 17:54:05.428964 24527 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37792:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:54:05.429049 24527 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37792:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:54:05.429759 24527 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4d2b53d2282148a09ac60779833ddd95: Sending DeleteTablet for 3 replicas of tablet 8fa8ddba79d444b3b60f12812e5dadd2
I20260808 17:54:05.430061 24710 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fa8ddba79d444b3b60f12812e5dadd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:54:05 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:47934
I20260808 17:54:05.430091 24909 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fa8ddba79d444b3b60f12812e5dadd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:54:05 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:49922
I20260808 17:54:05.430259 25099 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fa8ddba79d444b3b60f12812e5dadd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:54:05 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:43700
I20260808 17:54:05.430400 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 24621
I20260808 17:54:05.435586 25256 tablet_replica.cc:330] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263: stopping tablet replica
I20260808 17:54:05.435676 25256 raft_consensus.cc:2229] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:54:05.435792 25256 raft_consensus.cc:2258] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:54:05.436136 25256 ts_tablet_manager.cc:1905] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:54:05.437512 25256 ts_tablet_manager.cc:1918] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:54:05.437573 25256 log.cc:1196] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/8fa8ddba79d444b3b60f12812e5dadd2
I20260808 17:54:05.437801 25256 ts_tablet_manager.cc:1939] T 8fa8ddba79d444b3b60f12812e5dadd2 P e16d2df1db2e46f7a843f5a85e164263: Deleting consensus metadata
I20260808 17:54:05.438151 24506 catalog_manager.cc:4841] TS e16d2df1db2e46f7a843f5a85e164263 (127.28.213.131:35643): tablet 8fa8ddba79d444b3b60f12812e5dadd2 (table test-table [id=adc7a6afe2414c21b76633bec3e40575]) successfully deleted
I20260808 17:54:05.439713 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 24817
W20260808 17:54:05.439793 24508 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.213.129:35281 (error 108)
I20260808 17:54:05.445140 25211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.445015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:35281 (local address 127.0.0.1:47936)
0808 17:54:05.445063 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:05.445104 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.129:35281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 17:54:05.445292 24508 catalog_manager.cc:4584] TS d341928d715b435b9230af0c2fdafc0b (127.28.213.129:35281): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8fa8ddba79d444b3b60f12812e5dadd2: Network error: Client connection negotiation failed: client connection to 127.28.213.129:35281: connect: Connection refused (error 111)
I20260808 17:54:05.463034 25211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.462935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:44505 (local address 127.0.0.1:49928)
0808 17:54:05.462980 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:05.463005 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.130:44505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 17:54:05.463174 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 25004
I20260808 17:54:05.470999 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 24480
2026-08-08T17:54:05Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2197 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T17:54:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:05Z Disabled control of system clock
I20260808 17:54:05.499837 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:37355
--webserver_interface=127.28.213.190
--webserver_port=0
--builtin_ntp_servers=127.28.213.148:41105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:37355
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 17:54:05.577136 25264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:05.577345 25264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:05.577371 25264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:05.578464 25264 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:05.578502 25264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:05.578518 25264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:05.578533 25264 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:05.578548 25264 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:05.579840 25264 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:41105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:37355
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:37355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25264
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:05.580075 25264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:05.580328 25264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:05.584676 25272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:05.584717 25264 server_base.cc:1034] running on GCE node
W20260808 17:54:05.584681 25276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:05.584695 25274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:05.585165 25264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:05.585470 25264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:05.586596 25264 hybrid_clock.cc:648] HybridClock initialized: now 1786211645586586 us; error 27 us; skew 500 ppm
I20260808 17:54:05.590312 25264 webserver.cc:460] Webserver started at http://127.28.213.190:32843/ using document root <none> and password file <none>
I20260808 17:54:05.590540 25264 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:05.590583 25264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:05.590708 25264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:05.591727 25264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "afb1631a65944a749c584635662d2183"
format_stamp: "Formatted at 2026-08-08 17:54:05 on dist-test-slave-bndk"
server_key: "8099230bd2952f1eb3a500abdeaf3d79"
server_key_iv: "cf303410313fc2c52e27b9d19f3f0d9a"
server_key_version: "encryptionkey@0"
I20260808 17:54:05.592113 25264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "afb1631a65944a749c584635662d2183"
format_stamp: "Formatted at 2026-08-08 17:54:05 on dist-test-slave-bndk"
server_key: "8099230bd2952f1eb3a500abdeaf3d79"
server_key_iv: "cf303410313fc2c52e27b9d19f3f0d9a"
server_key_version: "encryptionkey@0"
I20260808 17:54:05.593402 25264 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 17:54:05.594085 25283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:05.594233 25264 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:05.594323 25264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "afb1631a65944a749c584635662d2183"
format_stamp: "Formatted at 2026-08-08 17:54:05 on dist-test-slave-bndk"
server_key: "8099230bd2952f1eb3a500abdeaf3d79"
server_key_iv: "cf303410313fc2c52e27b9d19f3f0d9a"
server_key_version: "encryptionkey@0"
I20260808 17:54:05.594383 25264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:05.608546 25264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:05.608795 25264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:05.608916 25264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:05.612556 25264 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:37355
I20260808 17:54:05.612586 25362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:37355 every 8 connection(s)
I20260808 17:54:05.612869 25264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:05.613493 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 25264
I20260808 17:54:05.613616 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:05.613843 29526 external_mini_cluster.cc:1428] Setting key aab30921f8bf0534998f2a81f4851753
I20260808 17:54:05.613885 25364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:05.616735 25364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183: Bootstrap starting.
I20260808 17:54:05.617408 25364 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:05.617687 25364 log.cc:824] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:05.618440 25364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183: No bootstrap required, opened a new log
I20260808 17:54:05.618964 25367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.614337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44648 (local address 127.28.213.190:37355)
0808 17:54:05.614525 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:05.614532 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:05.614555 (+ 23us) server_negotiation.cc:407] Connection header received
0808 17:54:05.614916 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:05.614922 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:05.614977 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:05.615079 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:05.615297 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.616112 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.617147 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.617587 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.617672 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:05.618368 (+ 696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:05.618371 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:05.618372 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:05.618536 (+ 164us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:05.618568 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:05.618579 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:05.618625 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:05.618706 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 17:54:05.618765 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":74,"threads_started":1}
I20260808 17:54:05.620335 25364 raft_consensus.cc:348] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afb1631a65944a749c584635662d2183" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 37355 } }
I20260808 17:54:05.620465 25364 raft_consensus.cc:374] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:05.620487 25364 raft_consensus.cc:729] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb1631a65944a749c584635662d2183, State: Initialized, Role: FOLLOWER
I20260808 17:54:05.620575 25364 consensus_queue.cc:260] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afb1631a65944a749c584635662d2183" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 37355 } }
I20260808 17:54:05.620642 25364 raft_consensus.cc:388] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:05.620669 25364 raft_consensus.cc:482] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:05.620699 25364 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:05.621147 25364 raft_consensus.cc:504] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afb1631a65944a749c584635662d2183" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 37355 } }
I20260808 17:54:05.621282 25364 leader_election.cc:302] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: afb1631a65944a749c584635662d2183; no voters:
I20260808 17:54:05.621419 25364 leader_election.cc:288] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:05.621464 25369 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:05.621609 25369 raft_consensus.cc:686] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183 [term 1 LEADER]: Becoming Leader. State: Replica: afb1631a65944a749c584635662d2183, State: Running, Role: LEADER
I20260808 17:54:05.621641 25364 sys_catalog.cc:564] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:05.621693 25369 consensus_queue.cc:237] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afb1631a65944a749c584635662d2183" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 37355 } }
I20260808 17:54:05.622181 25370 sys_catalog.cc:455] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "afb1631a65944a749c584635662d2183" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afb1631a65944a749c584635662d2183" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 37355 } } }
I20260808 17:54:05.622284 25370 sys_catalog.cc:458] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:05.622171 25373 sys_catalog.cc:455] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183 [sys.catalog]: SysCatalogTable state changed. Reason: New leader afb1631a65944a749c584635662d2183. Latest consensus state: current_term: 1 leader_uuid: "afb1631a65944a749c584635662d2183" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afb1631a65944a749c584635662d2183" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 37355 } } }
I20260808 17:54:05.622463 25373 sys_catalog.cc:458] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:05.622547 25384 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:05.623030 25384 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:05.624365 25384 catalog_manager.cc:1347] Generated new cluster ID: 1a19a48b131549ee96472e70314c8f04
I20260808 17:54:05.624418 25384 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:05.650311 25384 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:05.650822 25384 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:05.658712 25384 catalog_manager.cc:5868] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183: Generated new TSK 0
I20260808 17:54:05.658861 25384 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:05.668152 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:37355
--builtin_ntp_servers=127.28.213.148:41105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 17:54:05.751516 25401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:05.751703 25401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:05.751734 25401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:05.752826 25401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:05.752866 25401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:05.752898 25401 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:54:05.754235 25401 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:41105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:37355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:05.754460 25401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:05.754725 25401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:05.761595 25408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:05.761647 25401 server_base.cc:1034] running on GCE node
W20260808 17:54:05.761983 25407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:05.761682 25411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:05.762498 25401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:05.762739 25401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:05.763878 25401 hybrid_clock.cc:648] HybridClock initialized: now 1786211645763863 us; error 26 us; skew 500 ppm
I20260808 17:54:05.765069 25401 webserver.cc:460] Webserver started at http://127.28.213.129:33595/ using document root <none> and password file <none>
I20260808 17:54:05.765333 25401 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:05.765388 25401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:05.765527 25401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:05.766515 25401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "6bd3dea86e2d4d3ab442d9ee62efd74d"
format_stamp: "Formatted at 2026-08-08 17:54:05 on dist-test-slave-bndk"
server_key: "bc0b3015bbbc64d8aa3f6e324c8ede97"
server_key_iv: "1c81a02a6b59ecd4d669483868a8da2b"
server_key_version: "encryptionkey@0"
I20260808 17:54:05.766834 25401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "6bd3dea86e2d4d3ab442d9ee62efd74d"
format_stamp: "Formatted at 2026-08-08 17:54:05 on dist-test-slave-bndk"
server_key: "bc0b3015bbbc64d8aa3f6e324c8ede97"
server_key_iv: "1c81a02a6b59ecd4d669483868a8da2b"
server_key_version: "encryptionkey@0"
I20260808 17:54:05.768074 25401 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:54:05.768694 25419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:05.768841 25401 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:54:05.768923 25401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "6bd3dea86e2d4d3ab442d9ee62efd74d"
format_stamp: "Formatted at 2026-08-08 17:54:05 on dist-test-slave-bndk"
server_key: "bc0b3015bbbc64d8aa3f6e324c8ede97"
server_key_iv: "1c81a02a6b59ecd4d669483868a8da2b"
server_key_version: "encryptionkey@0"
I20260808 17:54:05.768993 25401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:05.789497 25401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:05.789734 25401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:05.789851 25401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:05.790037 25401 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:54:05.790331 25401 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:54:05.790370 25401 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:05.790396 25401 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:54:05.790424 25401 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:05.795696 25401 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:45629
I20260808 17:54:05.795758 25591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:45629 every 8 connection(s)
I20260808 17:54:05.796030 25401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:54:05.800659 25367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.796691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:42603 (local address 127.28.213.190:37355)
0808 17:54:05.796755 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:05.796757 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:05.796953 (+ 196us) server_negotiation.cc:407] Connection header received
0808 17:54:05.797413 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:05.797414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:05.797423 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:05.797500 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:05.798130 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.798621 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.799498 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.799668 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.799709 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:05.800455 (+ 746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:05.800456 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:05.800456 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:05.800461 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:05.800474 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:05.800478 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:05.800516 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:05.800566 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 17:54:05.800601 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:54:05.800830 25595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.796670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:37355 (local address 127.28.213.129:42603)
0808 17:54:05.796843 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:05.796882 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:05.797341 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:05.797557 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:05.797560 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:05.797568 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:05.798063 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:05.798068 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.798682 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.798683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:05.799440 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:05.799442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.799718 (+ 276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.799718 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:05.799814 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:05.800317 (+ 503us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:54:05.800317 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:05.800343 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:54:05.800367 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:05.800518 (+ 151us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:05.800521 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:05.800524 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:54:05.800567 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 17:54:05.800642 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":64,"threads_started":1}
I20260808 17:54:05.801316 25592 heartbeater.cc:347] Connected to a master server at 127.28.213.190:37355
I20260808 17:54:05.801402 25592 heartbeater.cc:464] Registering TS with master...
I20260808 17:54:05.801573 25592 heartbeater.cc:511] Master 127.28.213.190:37355 requested a full tablet report, sending...
I20260808 17:54:05.802028 25312 ts_manager.cc:194] Registered new tserver with Master: 6bd3dea86e2d4d3ab442d9ee62efd74d (127.28.213.129:45629)
I20260808 17:54:05.802594 25312 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.213.129:42603
I20260808 17:54:05.803613 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 25401
I20260808 17:54:05.803700 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:54:05.803889 29526 external_mini_cluster.cc:1428] Setting key 96211a3f91964ef28015441866a4f4bd
I20260808 17:54:05.804651 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:37355
--builtin_ntp_servers=127.28.213.148:41105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 17:54:05.882894 25596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:05.883082 25596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:05.883111 25596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:05.884183 25596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:05.884220 25596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:05.884251 25596 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:54:05.885557 25596 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:41105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:37355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25596
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:05.885766 25596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:05.886032 25596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:05.890544 25602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:05.890681 25607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:05.890663 25596 server_base.cc:1034] running on GCE node
W20260808 17:54:05.890537 25604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:05.890959 25596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:05.891160 25596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:05.892297 25596 hybrid_clock.cc:648] HybridClock initialized: now 1786211645892282 us; error 23 us; skew 500 ppm
I20260808 17:54:05.893491 25596 webserver.cc:460] Webserver started at http://127.28.213.130:35595/ using document root <none> and password file <none>
I20260808 17:54:05.893705 25596 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:05.893752 25596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:05.893877 25596 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:05.894815 25596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "f91f8bcc260a41e3acba8b50b77e500e"
format_stamp: "Formatted at 2026-08-08 17:54:05 on dist-test-slave-bndk"
server_key: "0af0405173a5016b7e1a687f5777aef1"
server_key_iv: "15bf15ab8431c3f45bc3718ef8d735f2"
server_key_version: "encryptionkey@0"
I20260808 17:54:05.895136 25596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "f91f8bcc260a41e3acba8b50b77e500e"
format_stamp: "Formatted at 2026-08-08 17:54:05 on dist-test-slave-bndk"
server_key: "0af0405173a5016b7e1a687f5777aef1"
server_key_iv: "15bf15ab8431c3f45bc3718ef8d735f2"
server_key_version: "encryptionkey@0"
I20260808 17:54:05.896354 25596 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:54:05.896951 25615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:05.897092 25596 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:05.897162 25596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "f91f8bcc260a41e3acba8b50b77e500e"
format_stamp: "Formatted at 2026-08-08 17:54:05 on dist-test-slave-bndk"
server_key: "0af0405173a5016b7e1a687f5777aef1"
server_key_iv: "15bf15ab8431c3f45bc3718ef8d735f2"
server_key_version: "encryptionkey@0"
I20260808 17:54:05.897259 25596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:05.908442 25596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:05.908640 25596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:05.908727 25596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:05.908877 25596 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:54:05.909118 25596 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:54:05.909147 25596 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:05.909165 25596 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:54:05.909178 25596 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:05.914513 25596 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:33725
I20260808 17:54:05.914547 25784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:33725 every 8 connection(s)
I20260808 17:54:05.914868 25596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:54:05.919193 25367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.915527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:42771 (local address 127.28.213.190:37355)
0808 17:54:05.915569 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:05.915571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:05.915769 (+ 198us) server_negotiation.cc:407] Connection header received
0808 17:54:05.916179 (+ 410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:05.916180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:05.916190 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:05.916239 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:05.916791 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.917277 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.918154 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.918323 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.918363 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:05.919023 (+ 660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:05.919024 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:05.919024 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:05.919028 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:05.919037 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:05.919040 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:05.919067 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:05.919120 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 17:54:05.919138 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:54:05.919406 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 25596
I20260808 17:54:05.919433 25793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:05.915493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:37355 (local address 127.28.213.130:42771)
0808 17:54:05.915658 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:05.915694 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:05.916108 (+ 414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:05.916286 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:05.916289 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:05.916296 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:05.916734 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:05.916737 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.917335 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.917336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:05.918094 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:05.918096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:05.918371 (+ 275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:05.918372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:05.918469 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:05.918918 (+ 449us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:54:05.918918 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:05.918944 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:54:05.918965 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:05.919074 (+ 109us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:05.919076 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:05.919078 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:54:05.919117 (+ 39us) client_negotiation.cc:240] Negotiation successful
0808 17:54:05.919188 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":77,"threads_started":1}
I20260808 17:54:05.919488 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:54:05.919677 29526 external_mini_cluster.cc:1428] Setting key 20da6a7b598f2b41543042557d5d84db
I20260808 17:54:05.919947 25786 heartbeater.cc:347] Connected to a master server at 127.28.213.190:37355
I20260808 17:54:05.920032 25786 heartbeater.cc:464] Registering TS with master...
I20260808 17:54:05.920192 25786 heartbeater.cc:511] Master 127.28.213.190:37355 requested a full tablet report, sending...
I20260808 17:54:05.920533 25312 ts_manager.cc:194] Registered new tserver with Master: f91f8bcc260a41e3acba8b50b77e500e (127.28.213.130:33725)
I20260808 17:54:05.920619 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:37355
--builtin_ntp_servers=127.28.213.148:41105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 17:54:05.920948 25312 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.213.130:42771
W20260808 17:54:05.998940 25796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:05.999122 25796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:05.999141 25796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:06.000308 25796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:06.000347 25796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:06.000371 25796 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:54:06.001773 25796 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:41105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:37355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25796
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:06.001976 25796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:06.002230 25796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:06.006717 25807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:06.006790 25809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:06.006728 25805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:06.006937 25796 server_base.cc:1034] running on GCE node
I20260808 17:54:06.007121 25796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:06.007298 25796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:06.008421 25796 hybrid_clock.cc:648] HybridClock initialized: now 1786211646008413 us; error 25 us; skew 500 ppm
I20260808 17:54:06.009632 25796 webserver.cc:460] Webserver started at http://127.28.213.131:35281/ using document root <none> and password file <none>
I20260808 17:54:06.009828 25796 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:06.009871 25796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:06.009990 25796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:06.010941 25796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "55c61479958e4ca39420f31c60b3cb5a"
format_stamp: "Formatted at 2026-08-08 17:54:06 on dist-test-slave-bndk"
server_key: "2c88cb9de225efb9b2ea85e7c1696dce"
server_key_iv: "bcdf8dff896b39e092880dbdd86a5fc9"
server_key_version: "encryptionkey@0"
I20260808 17:54:06.011245 25796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "55c61479958e4ca39420f31c60b3cb5a"
format_stamp: "Formatted at 2026-08-08 17:54:06 on dist-test-slave-bndk"
server_key: "2c88cb9de225efb9b2ea85e7c1696dce"
server_key_iv: "bcdf8dff896b39e092880dbdd86a5fc9"
server_key_version: "encryptionkey@0"
I20260808 17:54:06.012403 25796 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:54:06.013000 25818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:06.013125 25796 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:06.013204 25796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "55c61479958e4ca39420f31c60b3cb5a"
format_stamp: "Formatted at 2026-08-08 17:54:06 on dist-test-slave-bndk"
server_key: "2c88cb9de225efb9b2ea85e7c1696dce"
server_key_iv: "bcdf8dff896b39e092880dbdd86a5fc9"
server_key_version: "encryptionkey@0"
I20260808 17:54:06.013306 25796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:06.030866 25796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:06.031098 25796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:06.031216 25796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:06.031422 25796 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:54:06.031698 25796 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:54:06.031730 25796 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:06.031755 25796 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:54:06.031772 25796 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:06.037065 25796 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:42827
I20260808 17:54:06.037106 25991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:42827 every 8 connection(s)
I20260808 17:54:06.037401 25796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:54:06.041759 25367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:06.038019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:52101 (local address 127.28.213.190:37355)
0808 17:54:06.038083 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:06.038085 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:06.038314 (+ 229us) server_negotiation.cc:407] Connection header received
0808 17:54:06.038742 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:06.038743 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:06.038752 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:06.038799 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:06.039362 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.039828 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.040695 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.040865 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.040911 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:06.041566 (+ 655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:06.041567 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:06.041568 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:06.041572 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:06.041585 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:06.041588 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:06.041627 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:06.041680 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 17:54:06.041701 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 17:54:06.041921 25995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:06.038005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:37355 (local address 127.28.213.131:52101)
0808 17:54:06.038204 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:06.038241 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:06.038667 (+ 426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:06.038854 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:06.038857 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:06.038867 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:06.039306 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:06.039309 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.039888 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.039889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:06.040637 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:06.040639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.040917 (+ 278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.040918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:06.041013 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:06.041450 (+ 437us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:54:06.041450 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:06.041475 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:54:06.041495 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:06.041627 (+ 132us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:06.041629 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:06.041631 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:54:06.041672 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 17:54:06.041741 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":80,"threads_started":1}
I20260808 17:54:06.042346 25993 heartbeater.cc:347] Connected to a master server at 127.28.213.190:37355
I20260808 17:54:06.042434 25993 heartbeater.cc:464] Registering TS with master...
I20260808 17:54:06.042596 25993 heartbeater.cc:511] Master 127.28.213.190:37355 requested a full tablet report, sending...
I20260808 17:54:06.042923 25312 ts_manager.cc:194] Registered new tserver with Master: 55c61479958e4ca39420f31c60b3cb5a (127.28.213.131:42827)
I20260808 17:54:06.043269 25312 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.213.131:52101
I20260808 17:54:06.045588 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 25796
I20260808 17:54:06.045678 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:54:06.045848 29526 external_mini_cluster.cc:1428] Setting key 06a2e1b7c80fc59398c0afcdeb4347e4
I20260808 17:54:06.046633 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:54:06.050203 25367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:06.047815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44660 (local address 127.28.213.190:37355)
0808 17:54:06.047878 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:06.047880 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:06.047945 (+ 65us) server_negotiation.cc:407] Connection header received
0808 17:54:06.047992 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:06.047992 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:06.048000 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:06.048041 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:06.048170 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.048591 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.049281 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.049462 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.049504 (+ 42us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:06.050015 (+ 511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:06.050016 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:06.050016 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:06.050019 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:06.050028 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:06.050030 (+ 2us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:06.050078 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:06.050127 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 17:54:06.050134 (+ 7us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 17:54:06.051529 25312 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44660:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:54:06.052968 25312 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:54:06.058617 26005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:06.054842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:33725 (local address 127.0.0.1:55208)
0808 17:54:06.055149 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:06.055180 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:06.055234 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:06.055416 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:06.055419 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:06.055421 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:06.055481 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:06.055483 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.056455 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.056455 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:06.057606 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:06.057609 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.058342 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.058343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:06.058418 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:06.058431 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 17:54:06.058498 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 17:54:06.058547 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":91,"threads_started":1}
I20260808 17:54:06.058629 26008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:06.054968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55208 (local address 127.28.213.130:33725)
0808 17:54:06.055210 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:06.055215 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:06.055225 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:54:06.055311 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:06.055314 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:06.055329 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:06.055406 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:06.055538 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.056379 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.057701 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.058263 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.058333 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:06.058428 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:06.058513 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 17:54:06.058549 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":86,"threads_started":1}
I20260808 17:54:06.058971 26010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:06.054992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:42827 (local address 127.0.0.1:46274)
0808 17:54:06.055157 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:06.055168 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:06.055228 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:06.055533 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:06.055534 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:06.055536 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:06.055577 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:06.055579 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.056808 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.056809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:06.057841 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:06.057843 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.058751 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.058752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:06.058808 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:06.058812 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:54:06.058868 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 17:54:06.058904 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":80,"threads_started":1}
I20260808 17:54:06.059020 26011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:06.055053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46274 (local address 127.28.213.131:42827)
0808 17:54:06.055354 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:06.055358 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:06.055366 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:54:06.055395 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:06.055397 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:06.055418 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:06.055485 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:06.055648 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.056733 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.057902 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.058573 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.058638 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:06.058714 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:06.058894 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 17:54:06.058942 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":66,"threads_started":1}
I20260808 17:54:06.059329 26004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:06.054807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:45629 (local address 127.0.0.1:45320)
0808 17:54:06.055131 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:06.055168 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:06.055228 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:06.055549 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:06.055550 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:06.055552 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:06.055584 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:06.055586 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.057282 (+ 1696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.057284 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:06.058180 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:06.058182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.059143 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.059144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:06.059187 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:06.059190 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:54:06.059232 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 17:54:06.059268 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":51,"threads_started":1}
I20260808 17:54:06.059540 26009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:06.054993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45320 (local address 127.28.213.129:45629)
0808 17:54:06.055351 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:06.055354 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:06.055362 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:54:06.055397 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:06.055399 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:06.055414 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:06.055486 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:06.055653 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.056721 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.058266 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.058968 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.059028 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:06.059110 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:06.059424 (+ 314us) server_negotiation.cc:299] Negotiation successful
0808 17:54:06.059463 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":75,"threads_started":1}
I20260808 17:54:06.059485 25693 tablet_service.cc:1467] Processing CreateTablet for tablet 26db09559401419d89ae44e0ad8616ba (DEFAULT_TABLE table=test-table [id=8d9d27a0fb0947cd920f5336ceca1af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:54:06.059623 25883 tablet_service.cc:1467] Processing CreateTablet for tablet 26db09559401419d89ae44e0ad8616ba (DEFAULT_TABLE table=test-table [id=8d9d27a0fb0947cd920f5336ceca1af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:54:06.059844 25693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26db09559401419d89ae44e0ad8616ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:06.059938 25883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26db09559401419d89ae44e0ad8616ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:06.060171 25490 tablet_service.cc:1467] Processing CreateTablet for tablet 26db09559401419d89ae44e0ad8616ba (DEFAULT_TABLE table=test-table [id=8d9d27a0fb0947cd920f5336ceca1af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:54:06.060472 25490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26db09559401419d89ae44e0ad8616ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:06.062425 26012 tablet_bootstrap.cc:492] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e: Bootstrap starting.
I20260808 17:54:06.063067 26012 tablet_bootstrap.cc:654] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:06.063371 26012 log.cc:824] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:06.063607 26015 tablet_bootstrap.cc:492] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d: Bootstrap starting.
I20260808 17:54:06.063673 26014 tablet_bootstrap.cc:492] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a: Bootstrap starting.
I20260808 17:54:06.064229 26015 tablet_bootstrap.cc:654] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:06.064229 26014 tablet_bootstrap.cc:654] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:06.064545 26014 log.cc:824] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:06.064545 26015 log.cc:824] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:06.065248 26015 tablet_bootstrap.cc:492] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d: No bootstrap required, opened a new log
I20260808 17:54:06.065294 26012 tablet_bootstrap.cc:492] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e: No bootstrap required, opened a new log
I20260808 17:54:06.065320 26015 ts_tablet_manager.cc:1397] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:54:06.065359 26012 ts_tablet_manager.cc:1397] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 17:54:06.065488 26014 tablet_bootstrap.cc:492] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a: No bootstrap required, opened a new log
I20260808 17:54:06.065550 26014 ts_tablet_manager.cc:1397] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:54:06.067257 26012 raft_consensus.cc:348] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bd3dea86e2d4d3ab442d9ee62efd74d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45629 } } peers { permanent_uuid: "55c61479958e4ca39420f31c60b3cb5a" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42827 } } peers { permanent_uuid: "f91f8bcc260a41e3acba8b50b77e500e" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33725 } }
I20260808 17:54:06.067385 26012 raft_consensus.cc:374] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:06.067426 26012 raft_consensus.cc:729] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91f8bcc260a41e3acba8b50b77e500e, State: Initialized, Role: FOLLOWER
I20260808 17:54:06.067559 26012 consensus_queue.cc:260] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bd3dea86e2d4d3ab442d9ee62efd74d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45629 } } peers { permanent_uuid: "55c61479958e4ca39420f31c60b3cb5a" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42827 } } peers { permanent_uuid: "f91f8bcc260a41e3acba8b50b77e500e" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33725 } }
I20260808 17:54:06.067796 26012 ts_tablet_manager.cc:1428] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 17:54:06.067924 25786 heartbeater.cc:503] Master 127.28.213.190:37355 was elected leader, sending a full tablet report...
I20260808 17:54:06.067929 26015 raft_consensus.cc:348] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bd3dea86e2d4d3ab442d9ee62efd74d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45629 } } peers { permanent_uuid: "55c61479958e4ca39420f31c60b3cb5a" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42827 } } peers { permanent_uuid: "f91f8bcc260a41e3acba8b50b77e500e" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33725 } }
I20260808 17:54:06.067929 26014 raft_consensus.cc:348] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bd3dea86e2d4d3ab442d9ee62efd74d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45629 } } peers { permanent_uuid: "55c61479958e4ca39420f31c60b3cb5a" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42827 } } peers { permanent_uuid: "f91f8bcc260a41e3acba8b50b77e500e" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33725 } }
I20260808 17:54:06.068079 26015 raft_consensus.cc:374] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:06.068079 26014 raft_consensus.cc:374] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:06.068112 26015 raft_consensus.cc:729] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bd3dea86e2d4d3ab442d9ee62efd74d, State: Initialized, Role: FOLLOWER
I20260808 17:54:06.068112 26014 raft_consensus.cc:729] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55c61479958e4ca39420f31c60b3cb5a, State: Initialized, Role: FOLLOWER
I20260808 17:54:06.068255 26015 consensus_queue.cc:260] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bd3dea86e2d4d3ab442d9ee62efd74d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45629 } } peers { permanent_uuid: "55c61479958e4ca39420f31c60b3cb5a" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42827 } } peers { permanent_uuid: "f91f8bcc260a41e3acba8b50b77e500e" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33725 } }
I20260808 17:54:06.068251 26014 consensus_queue.cc:260] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bd3dea86e2d4d3ab442d9ee62efd74d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45629 } } peers { permanent_uuid: "55c61479958e4ca39420f31c60b3cb5a" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42827 } } peers { permanent_uuid: "f91f8bcc260a41e3acba8b50b77e500e" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33725 } }
I20260808 17:54:06.068516 26015 ts_tablet_manager.cc:1428] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:54:06.068524 26014 ts_tablet_manager.cc:1428] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 17:54:06.068652 25592 heartbeater.cc:503] Master 127.28.213.190:37355 was elected leader, sending a full tablet report...
I20260808 17:54:06.068749 25993 heartbeater.cc:503] Master 127.28.213.190:37355 was elected leader, sending a full tablet report...
I20260808 17:54:06.160712 26025 raft_consensus.cc:482] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:54:06.160826 26025 raft_consensus.cc:504] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bd3dea86e2d4d3ab442d9ee62efd74d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45629 } } peers { permanent_uuid: "55c61479958e4ca39420f31c60b3cb5a" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42827 } } peers { permanent_uuid: "f91f8bcc260a41e3acba8b50b77e500e" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33725 } }
I20260808 17:54:06.161188 26025 leader_election.cc:288] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55c61479958e4ca39420f31c60b3cb5a (127.28.213.131:42827), f91f8bcc260a41e3acba8b50b77e500e (127.28.213.130:33725)
I20260808 17:54:06.163866 26011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:06.161418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:57437 (local address 127.28.213.131:42827)
0808 17:54:06.161463 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:06.161465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:06.161475 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:54:06.161547 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:06.161548 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:06.161560 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:06.161627 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:06.161778 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.162271 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.163185 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.163556 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.163614 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:06.163623 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:06.163757 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 17:54:06.163796 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:54:06.163872 26008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:06.161457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:34761 (local address 127.28.213.130:33725)
0808 17:54:06.161496 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:06.161498 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:06.161638 (+ 140us) server_negotiation.cc:407] Connection header received
0808 17:54:06.161672 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:06.161673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:06.161682 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:06.161740 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:06.161878 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.162348 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.163224 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.163567 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.163629 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:06.163637 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:06.163775 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 17:54:06.163807 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:54:06.163880 25595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:06.161355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:42827 (local address 127.28.213.129:57437)
0808 17:54:06.161414 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:06.161425 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:06.161469 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:06.161638 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:06.161639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:06.161641 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:06.161714 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:06.161717 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.162341 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.162342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:06.163100 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:06.163102 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.163630 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.163631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:06.163696 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:06.163699 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:54:06.163740 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 17:54:06.163780 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 17:54:06.163885 26029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:06.161355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:33725 (local address 127.28.213.129:34761)
0808 17:54:06.161560 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:06.161570 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:06.161627 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:06.161747 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:06.161748 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:06.161749 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:06.161820 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:06.161821 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.162428 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.162428 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:06.163139 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:06.163141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.163646 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.163647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:06.163708 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:06.163711 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:54:06.163759 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 17:54:06.163796 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":27,"thread_start_us":113,"threads_started":1}
I20260808 17:54:06.164229 25918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26db09559401419d89ae44e0ad8616ba" candidate_uuid: "6bd3dea86e2d4d3ab442d9ee62efd74d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55c61479958e4ca39420f31c60b3cb5a" is_pre_election: true
I20260808 17:54:06.164373 25918 raft_consensus.cc:2454] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd3dea86e2d4d3ab442d9ee62efd74d in term 0.
I20260808 17:54:06.164494 25722 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26db09559401419d89ae44e0ad8616ba" candidate_uuid: "6bd3dea86e2d4d3ab442d9ee62efd74d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91f8bcc260a41e3acba8b50b77e500e" is_pre_election: true
I20260808 17:54:06.164616 25421 leader_election.cc:302] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55c61479958e4ca39420f31c60b3cb5a, 6bd3dea86e2d4d3ab442d9ee62efd74d; no voters:
I20260808 17:54:06.164644 25722 raft_consensus.cc:2454] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd3dea86e2d4d3ab442d9ee62efd74d in term 0.
I20260808 17:54:06.164743 26025 raft_consensus.cc:2781] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:54:06.164793 26025 raft_consensus.cc:482] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:54:06.164811 26025 raft_consensus.cc:3037] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d [term 0 FOLLOWER]: Advancing to term 1
W20260808 17:54:06.165323 25789 tablet.cc:2369] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:54:06.165616 26025 raft_consensus.cc:504] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bd3dea86e2d4d3ab442d9ee62efd74d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45629 } } peers { permanent_uuid: "55c61479958e4ca39420f31c60b3cb5a" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42827 } } peers { permanent_uuid: "f91f8bcc260a41e3acba8b50b77e500e" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33725 } }
I20260808 17:54:06.165735 26025 leader_election.cc:288] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d [CANDIDATE]: Term 1 election: Requested vote from peers 55c61479958e4ca39420f31c60b3cb5a (127.28.213.131:42827), f91f8bcc260a41e3acba8b50b77e500e (127.28.213.130:33725)
I20260808 17:54:06.165916 25722 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26db09559401419d89ae44e0ad8616ba" candidate_uuid: "6bd3dea86e2d4d3ab442d9ee62efd74d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91f8bcc260a41e3acba8b50b77e500e"
I20260808 17:54:06.165907 25918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26db09559401419d89ae44e0ad8616ba" candidate_uuid: "6bd3dea86e2d4d3ab442d9ee62efd74d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55c61479958e4ca39420f31c60b3cb5a"
I20260808 17:54:06.165984 25918 raft_consensus.cc:3037] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:06.165984 25722 raft_consensus.cc:3037] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:06.166873 25722 raft_consensus.cc:2454] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd3dea86e2d4d3ab442d9ee62efd74d in term 1.
I20260808 17:54:06.166879 25918 raft_consensus.cc:2454] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd3dea86e2d4d3ab442d9ee62efd74d in term 1.
I20260808 17:54:06.167053 25424 leader_election.cc:302] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd3dea86e2d4d3ab442d9ee62efd74d, f91f8bcc260a41e3acba8b50b77e500e; no voters:
I20260808 17:54:06.167160 26025 raft_consensus.cc:2781] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:06.167294 26025 raft_consensus.cc:686] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d [term 1 LEADER]: Becoming Leader. State: Replica: 6bd3dea86e2d4d3ab442d9ee62efd74d, State: Running, Role: LEADER
I20260808 17:54:06.167375 26025 consensus_queue.cc:237] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bd3dea86e2d4d3ab442d9ee62efd74d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45629 } } peers { permanent_uuid: "55c61479958e4ca39420f31c60b3cb5a" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42827 } } peers { permanent_uuid: "f91f8bcc260a41e3acba8b50b77e500e" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33725 } }
I20260808 17:54:06.168123 25312 catalog_manager.cc:5495] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6bd3dea86e2d4d3ab442d9ee62efd74d (127.28.213.129). New cstate: current_term: 1 leader_uuid: "6bd3dea86e2d4d3ab442d9ee62efd74d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bd3dea86e2d4d3ab442d9ee62efd74d" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55c61479958e4ca39420f31c60b3cb5a" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91f8bcc260a41e3acba8b50b77e500e" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260808 17:54:06.175182 26009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:06.172993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45330 (local address 127.28.213.129:45629)
0808 17:54:06.173034 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:06.173036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:06.173044 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:54:06.173073 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:06.173074 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:06.173091 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:06.173151 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:54:06.173275 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.173700 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.174416 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:06.174651 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:06.174705 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:06.174867 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:54:06.174959 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:54:06.175036 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:06.175091 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 17:54:06.175101 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:54:06.176599 25722 raft_consensus.cc:1261] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e [term 1 FOLLOWER]: Refusing update from remote peer 6bd3dea86e2d4d3ab442d9ee62efd74d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:54:06.176661 25918 raft_consensus.cc:1261] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a [term 1 FOLLOWER]: Refusing update from remote peer 6bd3dea86e2d4d3ab442d9ee62efd74d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:54:06.176884 26025 consensus_queue.cc:1035] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91f8bcc260a41e3acba8b50b77e500e" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:54:06.177011 26030 consensus_queue.cc:1035] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d [LEADER]: Connected to new peer: Peer: permanent_uuid: "55c61479958e4ca39420f31c60b3cb5a" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 42827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:54:06.179517 26035 mvcc.cc:205] Tried to move back new op lower bound from 7316322902737321984 to 7316322902702112768. Current Snapshot: MvccSnapshot[applied={T|T < 7316322902737321984}]
I20260808 17:54:06.181108 25312 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:54:06.181185 25312 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:54:06.181840 25312 catalog_manager.cc:5782] T 00000000000000000000000000000000 P afb1631a65944a749c584635662d2183: Sending DeleteTablet for 3 replicas of tablet 26db09559401419d89ae44e0ad8616ba
I20260808 17:54:06.182173 25693 tablet_service.cc:1514] Processing DeleteTablet for tablet 26db09559401419d89ae44e0ad8616ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:54:06 UTC) from {username='slave'} at 127.0.0.1:55208
I20260808 17:54:06.182211 25490 tablet_service.cc:1514] Processing DeleteTablet for tablet 26db09559401419d89ae44e0ad8616ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:54:06 UTC) from {username='slave'} at 127.0.0.1:45320
I20260808 17:54:06.182423 26053 tablet_replica.cc:330] T 26db09559401419d89ae44e0ad8616ba P 6bd3dea86e2d4d3ab442d9ee62efd74d: stopping tablet replica
I20260808 17:54:06.182524 25883 tablet_service.cc:1514] Processing DeleteTablet for tablet 26db09559401419d89ae44e0ad8616ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:54:06 UTC) from {username='slave'} at 127.0.0.1:46274
I20260808 17:54:06.182540 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 25401
I20260808 17:54:06.188974 26054 tablet_replica.cc:330] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a: stopping tablet replica
I20260808 17:54:06.189109 26054 raft_consensus.cc:2229] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:54:06.189284 26054 raft_consensus.cc:2258] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:54:06.190997 26048 tablet_replica.cc:330] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e: stopping tablet replica
I20260808 17:54:06.191102 26048 raft_consensus.cc:2229] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:54:06.191200 26048 raft_consensus.cc:2258] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:54:06.192307 26054 ts_tablet_manager.cc:1905] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:54:06.192691 26048 ts_tablet_manager.cc:1905] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:54:06.193830 26054 ts_tablet_manager.cc:1918] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:54:06.193894 26054 log.cc:1196] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/26db09559401419d89ae44e0ad8616ba
I20260808 17:54:06.194100 26054 ts_tablet_manager.cc:1939] T 26db09559401419d89ae44e0ad8616ba P 55c61479958e4ca39420f31c60b3cb5a: Deleting consensus metadata
I20260808 17:54:06.194353 26048 ts_tablet_manager.cc:1918] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:54:06.194433 26048 log.cc:1196] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/26db09559401419d89ae44e0ad8616ba
I20260808 17:54:06.194523 25285 catalog_manager.cc:4841] TS 55c61479958e4ca39420f31c60b3cb5a (127.28.213.131:42827): tablet 26db09559401419d89ae44e0ad8616ba (table test-table [id=8d9d27a0fb0947cd920f5336ceca1af1]) successfully deleted
I20260808 17:54:06.194657 26048 ts_tablet_manager.cc:1939] T 26db09559401419d89ae44e0ad8616ba P f91f8bcc260a41e3acba8b50b77e500e: Deleting consensus metadata
I20260808 17:54:06.195063 25287 catalog_manager.cc:4841] TS f91f8bcc260a41e3acba8b50b77e500e (127.28.213.130:33725): tablet 26db09559401419d89ae44e0ad8616ba (table test-table [id=8d9d27a0fb0947cd920f5336ceca1af1]) successfully deleted
W20260808 17:54:06.196883 25285 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.213.129:45629 (error 108)
I20260808 17:54:06.197083 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 25596
I20260808 17:54:06.200250 26004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:06.197198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:45629 (local address 127.0.0.1:45346)
0808 17:54:06.200163 (+ 2965us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:06.200215 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.129:45629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2940}
W20260808 17:54:06.204150 25285 catalog_manager.cc:4584] TS 6bd3dea86e2d4d3ab442d9ee62efd74d (127.28.213.129:45629): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 26db09559401419d89ae44e0ad8616ba: Network error: Client connection negotiation failed: client connection to 127.28.213.129:45629: connect: Connection refused (error 111)
I20260808 17:54:06.207567 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 25796
I20260808 17:54:06.215054 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 25264
2026-08-08T17:54:06Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (746 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:06 dist-test-slave-bndk krb5kdc[26062](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:06 dist-test-slave-bndk krb5kdc[26062](info): set up 2 sockets
Aug 08 17:54:06 dist-test-slave-bndk krb5kdc[26062](info): commencing operation
krb5kdc: starting...
W20260808 17:54:07.336653 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:07 dist-test-slave-bndk krb5kdc[26062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:54:07.443428 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:36667
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:33523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:36667
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:07.521631 26078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:07.521807 26078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:07.521827 26078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:07.522895 26078 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:07.522934 26078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:07.522948 26078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:07.522969 26078 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:07.522993 26078 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:07.524402 26078 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:33523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:36667
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:36667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:07.524617 26078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:07.524870 26078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:07.529193 26084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:07.529284 26087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:07.529321 26078 server_base.cc:1034] running on GCE node
W20260808 17:54:07.529202 26090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:07.529673 26078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:07.529943 26078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:07.531080 26078 hybrid_clock.cc:648] HybridClock initialized: now 1786211647531060 us; error 32 us; skew 500 ppm
Aug 08 17:54:07 dist-test-slave-bndk krb5kdc[26062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211647, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:07.533341 26078 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:54:07.533752 26078 webserver.cc:460] Webserver started at http://127.28.213.190:38329/ using document root <none> and password file <none>
I20260808 17:54:07.533964 26078 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:07.534013 26078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:07.534137 26078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:07.535087 26078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "58770aa34f8d406bac27c28b1be98ec1"
format_stamp: "Formatted at 2026-08-08 17:54:07 on dist-test-slave-bndk"
server_key: "c71152e6628550d03352c5e90864c112"
server_key_iv: "5ed9b6f96a1121c88d71084f8641513d"
server_key_version: "encryptionkey@0"
I20260808 17:54:07.535403 26078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "58770aa34f8d406bac27c28b1be98ec1"
format_stamp: "Formatted at 2026-08-08 17:54:07 on dist-test-slave-bndk"
server_key: "c71152e6628550d03352c5e90864c112"
server_key_iv: "5ed9b6f96a1121c88d71084f8641513d"
server_key_version: "encryptionkey@0"
I20260808 17:54:07.536566 26078 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:54:07.538676 26100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:07.538806 26078 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260808 17:54:07.538867 26078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "58770aa34f8d406bac27c28b1be98ec1"
format_stamp: "Formatted at 2026-08-08 17:54:07 on dist-test-slave-bndk"
server_key: "c71152e6628550d03352c5e90864c112"
server_key_iv: "5ed9b6f96a1121c88d71084f8641513d"
server_key_version: "encryptionkey@0"
I20260808 17:54:07.538931 26078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:07.566332 26078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:07.568280 26078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:07.568413 26078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:07.572080 26078 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:36667
I20260808 17:54:07.572132 26181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:36667 every 8 connection(s)
I20260808 17:54:07.572433 26078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:07.573271 26182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:07.575454 26182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1: Bootstrap starting.
I20260808 17:54:07.575995 26182 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:07.576260 26182 log.cc:824] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:07.576893 26182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1: No bootstrap required, opened a new log
I20260808 17:54:07.577533 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 26078
I20260808 17:54:07.577633 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:07.577807 29526 external_mini_cluster.cc:1428] Setting key ed3b78cc48af7afa1978efc3224eeb38
I20260808 17:54:07.578728 26182 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58770aa34f8d406bac27c28b1be98ec1" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36667 } }
I20260808 17:54:07.578856 26182 raft_consensus.cc:374] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:07.578889 26182 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58770aa34f8d406bac27c28b1be98ec1, State: Initialized, Role: FOLLOWER
I20260808 17:54:07.579021 26182 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58770aa34f8d406bac27c28b1be98ec1" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36667 } }
I20260808 17:54:07.579085 26182 raft_consensus.cc:388] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:07.579116 26182 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:07.579164 26182 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:07.579960 26182 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58770aa34f8d406bac27c28b1be98ec1" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36667 } }
I20260808 17:54:07.580062 26182 leader_election.cc:302] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58770aa34f8d406bac27c28b1be98ec1; no voters:
I20260808 17:54:07.580217 26182 leader_election.cc:288] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:07.580256 26190 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:07.580371 26190 raft_consensus.cc:686] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1 [term 1 LEADER]: Becoming Leader. State: Replica: 58770aa34f8d406bac27c28b1be98ec1, State: Running, Role: LEADER
I20260808 17:54:07.580453 26190 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58770aa34f8d406bac27c28b1be98ec1" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36667 } }
I20260808 17:54:07.580489 26182 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:07.580767 26190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58770aa34f8d406bac27c28b1be98ec1. Latest consensus state: current_term: 1 leader_uuid: "58770aa34f8d406bac27c28b1be98ec1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58770aa34f8d406bac27c28b1be98ec1" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36667 } } }
I20260808 17:54:07.580833 26190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:07.581032 26199 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:07.581532 26199 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:07.581902 26193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58770aa34f8d406bac27c28b1be98ec1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58770aa34f8d406bac27c28b1be98ec1" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36667 } } }
I20260808 17:54:07.583076 26199 catalog_manager.cc:1347] Generated new cluster ID: a54ebb08a43248979e3a77bb43921d5b
I20260808 17:54:07.583950 26193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:07.583988 26199 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:54:07 dist-test-slave-bndk krb5kdc[26062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:07.588058 26189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:07.578241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34216 (local address 127.28.213.190:36667)
0808 17:54:07.578435 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:07.578444 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:07.578468 (+ 24us) server_negotiation.cc:407] Connection header received
0808 17:54:07.578702 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:07.578708 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:07.578751 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:07.578864 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:07.579549 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:07.580578 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:07.581623 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:07.582168 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:07.582265 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:07.584738 (+ 2473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:07.584742 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:07.584742 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:07.584753 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:07.586475 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:07.586816 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:07.586820 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:07.586820 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:07.586929 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:07.587108 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:07.587109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:07.587109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:07.587342 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:07.587501 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:07.587594 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 17:54:07.587722 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":87,"threads_started":1}
I20260808 17:54:07.602504 26199 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:07.602977 26199 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:07.606423 26199 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1: Generated new TSK 0
I20260808 17:54:07.606576 26199 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.213.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
Entry for principal kudu/127.28.213.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab.
I20260808 17:54:07.635301 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:36667
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:33523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:07.717517 26221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:07.717715 26221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:07.717743 26221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:07.718866 26221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:07.718906 26221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:07.718941 26221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:54:07.720374 26221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:33523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.129.keytab
--principal=kudu/127.28.213.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:36667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:07.720597 26221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:07.720822 26221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:07.725507 26235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:07.725656 26232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:07.725540 26221 server_base.cc:1034] running on GCE node
W20260808 17:54:07.725512 26231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:07.727528 26221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:07.727748 26221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:07.728883 26221 hybrid_clock.cc:648] HybridClock initialized: now 1786211647728869 us; error 30 us; skew 500 ppm
Aug 08 17:54:07 dist-test-slave-bndk krb5kdc[26062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211647, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:07.731236 26221 init.cc:377] Logged in from keytab as kudu/127.28.213.129@KRBTEST.COM (short username kudu)
I20260808 17:54:07.731667 26221 webserver.cc:460] Webserver started at http://127.28.213.129:35669/ using document root <none> and password file <none>
I20260808 17:54:07.731858 26221 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:07.731912 26221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:07.732038 26221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:07.733022 26221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "8c3ed420e40d47afb08750c28dce8557"
format_stamp: "Formatted at 2026-08-08 17:54:07 on dist-test-slave-bndk"
server_key: "b3acb2d7b1f21cf5d37d563b75e88553"
server_key_iv: "a7e0174b2ac6bd9c66cd03b507d70aff"
server_key_version: "encryptionkey@0"
I20260808 17:54:07.733369 26221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "8c3ed420e40d47afb08750c28dce8557"
format_stamp: "Formatted at 2026-08-08 17:54:07 on dist-test-slave-bndk"
server_key: "b3acb2d7b1f21cf5d37d563b75e88553"
server_key_iv: "a7e0174b2ac6bd9c66cd03b507d70aff"
server_key_version: "encryptionkey@0"
I20260808 17:54:07.734705 26221 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:54:07.735409 26247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:07.735571 26221 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:54:07.735651 26221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "8c3ed420e40d47afb08750c28dce8557"
format_stamp: "Formatted at 2026-08-08 17:54:07 on dist-test-slave-bndk"
server_key: "b3acb2d7b1f21cf5d37d563b75e88553"
server_key_iv: "a7e0174b2ac6bd9c66cd03b507d70aff"
server_key_version: "encryptionkey@0"
I20260808 17:54:07.735713 26221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:07.772729 26221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:07.774504 26221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:07.774642 26221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:07.774868 26221 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:54:07.775174 26221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:54:07.775209 26221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:07.775239 26221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:54:07.775265 26221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:07.780532 26221 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:40487
I20260808 17:54:07.780616 26431 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:40487 every 8 connection(s)
I20260808 17:54:07.780936 26221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
Aug 08 17:54:07 dist-test-slave-bndk krb5kdc[26062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211647, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.129@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:07.789050 26189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:07.781616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:43847 (local address 127.28.213.190:36667)
0808 17:54:07.781703 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:07.781705 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:07.781879 (+ 174us) server_negotiation.cc:407] Connection header received
0808 17:54:07.782394 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:07.782395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:07.782411 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:07.782460 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:07.783312 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:07.783799 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:07.784719 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:07.784911 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:07.784955 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:07.786819 (+ 1864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:07.786820 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:07.786820 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:07.786829 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:07.788072 (+ 1243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:07.788370 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:07.788370 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:07.788371 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:07.788425 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:07.788588 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:07.788588 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:07.788589 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:07.788679 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:07.788723 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:07.788924 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 17:54:07.788986 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 17:54:07.789204 26434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:07.781580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:36667 (local address 127.28.213.129:43847)
0808 17:54:07.781747 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:07.781801 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:07.782314 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:07.782515 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:07.782519 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:07.783064 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:07.783247 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:07.783252 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:07.783884 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:07.783885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:07.784659 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:07.784661 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:07.784964 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:07.784964 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:07.785056 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:07.785476 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:07.785484 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:07.786736 (+ 1252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:07.788132 (+ 1396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:07.788134 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:07.788136 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:07.788321 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:07.788465 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:07.788465 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:07.788466 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:07.788548 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:07.788719 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:07.788721 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:07.788823 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 17:54:07.788905 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 17:54:07.789015 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":79,"threads_started":1}
I20260808 17:54:07.789672 26432 heartbeater.cc:347] Connected to a master server at 127.28.213.190:36667
I20260808 17:54:07.789754 26432 heartbeater.cc:464] Registering TS with master...
I20260808 17:54:07.789891 26432 heartbeater.cc:511] Master 127.28.213.190:36667 requested a full tablet report, sending...
I20260808 17:54:07.790297 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 26221
I20260808 17:54:07.790310 26127 ts_manager.cc:194] Registered new tserver with Master: 8c3ed420e40d47afb08750c28dce8557 (127.28.213.129:40487)
I20260808 17:54:07.790402 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:54:07.790583 29526 external_mini_cluster.cc:1428] Setting key 998698fd9bd836dff9577c115fc2af79
I20260808 17:54:07.791096 26127 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.129@KRBTEST.COM'} at 127.28.213.129:43847
WARNING: no policy specified for kudu/127.28.213.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
Entry for principal kudu/127.28.213.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab.
I20260808 17:54:07.813831 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:36667
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:33523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:07.892242 26440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:07.892421 26440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:07.892441 26440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:07.893613 26440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:07.893656 26440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:07.893683 26440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:54:07.895058 26440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:33523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.130.keytab
--principal=kudu/127.28.213.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:36667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:07.895251 26440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:07.895442 26440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:07.899833 26446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:07.899893 26447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:07.899874 26449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:07.900045 26440 server_base.cc:1034] running on GCE node
I20260808 17:54:07.900213 26440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:07.900411 26440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:07.901542 26440 hybrid_clock.cc:648] HybridClock initialized: now 1786211647901529 us; error 24 us; skew 500 ppm
Aug 08 17:54:07 dist-test-slave-bndk krb5kdc[26062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211647, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:07.903735 26440 init.cc:377] Logged in from keytab as kudu/127.28.213.130@KRBTEST.COM (short username kudu)
I20260808 17:54:07.904122 26440 webserver.cc:460] Webserver started at http://127.28.213.130:37241/ using document root <none> and password file <none>
I20260808 17:54:07.904286 26440 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:07.904325 26440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:07.904414 26440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:07.905359 26440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "df333839c13f41c79906bf2d228f25d6"
format_stamp: "Formatted at 2026-08-08 17:54:07 on dist-test-slave-bndk"
server_key: "5a557f8bac21b0f31b0ecfeefdadb2f2"
server_key_iv: "53de8fbd592b61360cc3313d51196004"
server_key_version: "encryptionkey@0"
I20260808 17:54:07.905644 26440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "df333839c13f41c79906bf2d228f25d6"
format_stamp: "Formatted at 2026-08-08 17:54:07 on dist-test-slave-bndk"
server_key: "5a557f8bac21b0f31b0ecfeefdadb2f2"
server_key_iv: "53de8fbd592b61360cc3313d51196004"
server_key_version: "encryptionkey@0"
I20260808 17:54:07.906783 26440 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:54:07.907495 26458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:07.907656 26440 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:54:07.907723 26440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "df333839c13f41c79906bf2d228f25d6"
format_stamp: "Formatted at 2026-08-08 17:54:07 on dist-test-slave-bndk"
server_key: "5a557f8bac21b0f31b0ecfeefdadb2f2"
server_key_iv: "53de8fbd592b61360cc3313d51196004"
server_key_version: "encryptionkey@0"
I20260808 17:54:07.907773 26440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:07.932341 26440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:07.933946 26440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:07.934047 26440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:07.934226 26440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:54:07.934456 26440 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:54:07.934487 26440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:07.934506 26440 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:54:07.934523 26440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:07.939929 26440 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:35875
I20260808 17:54:07.939967 26641 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:35875 every 8 connection(s)
I20260808 17:54:07.940234 26440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
Aug 08 17:54:07 dist-test-slave-bndk krb5kdc[26062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211647, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.130@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:07.948134 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 26440
I20260808 17:54:07.948254 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:54:07.948350 26189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:07.940850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:56465 (local address 127.28.213.190:36667)
0808 17:54:07.940901 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:07.940903 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:07.941087 (+ 184us) server_negotiation.cc:407] Connection header received
0808 17:54:07.941636 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:07.941637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:07.941647 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:07.941688 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:07.942585 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:07.943094 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:07.944023 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:07.944204 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:07.944250 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:07.946138 (+ 1888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:07.946140 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:07.946140 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:07.946147 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:07.947337 (+ 1190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:07.947623 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:07.947623 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:07.947624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:07.947669 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:07.947829 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:07.947830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:07.947830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:07.947919 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:07.947962 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:07.948183 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 17:54:07.948267 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 17:54:07.948442 29526 external_mini_cluster.cc:1428] Setting key 707f55a1860b9ad93124e5c4d78798d8
I20260808 17:54:07.948495 26646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:07.940805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:36667 (local address 127.28.213.130:56465)
0808 17:54:07.940972 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:07.941011 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:07.941538 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:07.941749 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:07.941752 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:07.942279 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:07.942512 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:07.942518 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:07.943166 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:07.943166 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:07.943964 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:07.943967 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:07.944257 (+ 290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:07.944258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:07.944345 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:07.944723 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:07.944730 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:07.946059 (+ 1329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:07.947395 (+ 1336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:07.947397 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:07.947399 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:07.947575 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:07.947709 (+ 134us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:07.947710 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:07.947710 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:07.947790 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:07.947959 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:07.947962 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:07.948076 (+ 114us) client_negotiation.cc:769] Sending connection context
0808 17:54:07.948146 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 17:54:07.948277 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":89,"threads_started":1}
I20260808 17:54:07.948952 26643 heartbeater.cc:347] Connected to a master server at 127.28.213.190:36667
I20260808 17:54:07.949055 26643 heartbeater.cc:464] Registering TS with master...
I20260808 17:54:07.949255 26643 heartbeater.cc:511] Master 127.28.213.190:36667 requested a full tablet report, sending...
I20260808 17:54:07.949632 26127 ts_manager.cc:194] Registered new tserver with Master: df333839c13f41c79906bf2d228f25d6 (127.28.213.130:35875)
I20260808 17:54:07.949975 26127 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.130@KRBTEST.COM'} at 127.28.213.130:56465
WARNING: no policy specified for kudu/127.28.213.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
Entry for principal kudu/127.28.213.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab.
I20260808 17:54:07.970973 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:36667
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:33523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:08.048409 26652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:08.048592 26652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:08.048621 26652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:08.049727 26652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:08.049767 26652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:08.049803 26652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:54:08.051162 26652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:33523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.131.keytab
--principal=kudu/127.28.213.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:36667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:08.051394 26652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:08.051596 26652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:08.056185 26663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:08.056226 26652 server_base.cc:1034] running on GCE node
W20260808 17:54:08.056190 26660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:08.056190 26661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:08.056597 26652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:08.056828 26652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:08.057966 26652 hybrid_clock.cc:648] HybridClock initialized: now 1786211648057955 us; error 30 us; skew 500 ppm
Aug 08 17:54:08 dist-test-slave-bndk krb5kdc[26062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211648, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:08.060189 26652 init.cc:377] Logged in from keytab as kudu/127.28.213.131@KRBTEST.COM (short username kudu)
I20260808 17:54:08.060551 26652 webserver.cc:460] Webserver started at http://127.28.213.131:46797/ using document root <none> and password file <none>
I20260808 17:54:08.060709 26652 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:08.060745 26652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:08.060830 26652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:08.061794 26652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "03560cef4a9d40809f891a2c50223af1"
format_stamp: "Formatted at 2026-08-08 17:54:08 on dist-test-slave-bndk"
server_key: "6fd8a6af985e47e095054ce80180b2a5"
server_key_iv: "53b837b79348b34a431b73ff7f93a90d"
server_key_version: "encryptionkey@0"
I20260808 17:54:08.062085 26652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "03560cef4a9d40809f891a2c50223af1"
format_stamp: "Formatted at 2026-08-08 17:54:08 on dist-test-slave-bndk"
server_key: "6fd8a6af985e47e095054ce80180b2a5"
server_key_iv: "53b837b79348b34a431b73ff7f93a90d"
server_key_version: "encryptionkey@0"
I20260808 17:54:08.063211 26652 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:54:08.063813 26674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:08.063964 26652 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:08.064041 26652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "03560cef4a9d40809f891a2c50223af1"
format_stamp: "Formatted at 2026-08-08 17:54:08 on dist-test-slave-bndk"
server_key: "6fd8a6af985e47e095054ce80180b2a5"
server_key_iv: "53b837b79348b34a431b73ff7f93a90d"
server_key_version: "encryptionkey@0"
I20260808 17:54:08.064093 26652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:08.079037 26652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:08.080891 26652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:08.080996 26652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:08.081178 26652 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:54:08.081534 26652 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:54:08.081570 26652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:08.081591 26652 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:54:08.081607 26652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:08.087129 26652 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:41553
I20260808 17:54:08.087196 26838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:41553 every 8 connection(s)
I20260808 17:54:08.087466 26652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
Aug 08 17:54:08 dist-test-slave-bndk krb5kdc[26062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211648, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.131@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:08.094995 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 26652
I20260808 17:54:08.095099 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:54:08.095256 29526 external_mini_cluster.cc:1428] Setting key 45f28c85b2746dcabf2f66c22baa988f
I20260808 17:54:08.095784 26189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.088098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:59861 (local address 127.28.213.190:36667)
0808 17:54:08.088137 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:08.088139 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:08.088344 (+ 205us) server_negotiation.cc:407] Connection header received
0808 17:54:08.088783 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:08.088784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:08.088795 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:08.088844 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:08.089720 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.090199 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.091095 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.091264 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.091314 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:08.093281 (+ 1967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:08.093283 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:08.093283 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:08.093309 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:08.094447 (+ 1138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:08.094783 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:08.094784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:08.094784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:08.094832 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:08.095107 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:08.095109 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:08.095109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:08.095239 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:08.095351 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:08.095595 (+ 244us) server_negotiation.cc:299] Negotiation successful
0808 17:54:08.095693 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 17:54:08.095911 26842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.088092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:36667 (local address 127.28.213.131:59861)
0808 17:54:08.088234 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:08.088268 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:08.088711 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:08.088900 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:08.088903 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:08.089474 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:08.089657 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:08.089662 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.090258 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.090259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:08.091034 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:08.091036 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.091322 (+ 286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.091323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:08.091424 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:08.091809 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:08.091819 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:08.093172 (+ 1353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:08.094511 (+ 1339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:08.094516 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:08.094518 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:08.094722 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:08.094885 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:08.094885 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:08.094886 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:08.095018 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:08.095309 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:08.095317 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:08.095458 (+ 141us) client_negotiation.cc:769] Sending connection context
0808 17:54:08.095554 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 17:54:08.095704 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":78,"threads_started":1}
I20260808 17:54:08.096334 26839 heartbeater.cc:347] Connected to a master server at 127.28.213.190:36667
I20260808 17:54:08.096427 26839 heartbeater.cc:464] Registering TS with master...
I20260808 17:54:08.096588 26839 heartbeater.cc:511] Master 127.28.213.190:36667 requested a full tablet report, sending...
I20260808 17:54:08.096920 26127 ts_manager.cc:194] Registered new tserver with Master: 03560cef4a9d40809f891a2c50223af1 (127.28.213.131:41553)
I20260808 17:54:08.097276 26127 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.213.131@KRBTEST.COM'} at 127.28.213.131:59861
I20260808 17:54:08.106964 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:54:08.113484 26189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.108174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34218 (local address 127.28.213.190:36667)
0808 17:54:08.108229 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:08.108231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:08.108318 (+ 87us) server_negotiation.cc:407] Connection header received
0808 17:54:08.108378 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:08.108379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:08.108388 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:08.108437 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:08.108923 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.109430 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.110126 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.110324 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.110376 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:08.111459 (+ 1083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:08.111461 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:08.111461 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:08.111468 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:08.112473 (+ 1005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:08.112763 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:08.112764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:08.112764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:08.112814 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:08.112981 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:08.112981 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:08.112982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:08.113113 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:08.113197 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:08.113323 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 17:54:08.113394 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:54:08.114765 26127 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34218:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:54:08.116542 26127 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:54:08.122507 26859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.118587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:35875 (local address 127.0.0.1:45350)
0808 17:54:08.118891 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:08.118901 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:08.118954 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:08.119230 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:08.119233 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:08.119235 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:08.119296 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:08.119298 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.120319 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.120320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:08.121555 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:08.121558 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.122213 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.122214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:08.122302 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:08.122316 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 17:54:08.122377 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 17:54:08.122428 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":72,"threads_started":1}
I20260808 17:54:08.122705 26854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.118582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:40487 (local address 127.0.0.1:33600)
0808 17:54:08.118739 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:08.118775 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:08.118841 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:08.119299 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:08.119299 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:08.119302 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:08.119349 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:08.119350 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.120550 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.120551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:08.121607 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:08.121609 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.122501 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.122501 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:08.122559 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:08.122564 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:54:08.122609 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 17:54:08.122645 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":50,"threads_started":1}
I20260808 17:54:08.122722 26861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.118925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45350 (local address 127.28.213.130:35875)
0808 17:54:08.119082 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:08.119085 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:08.119093 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:54:08.119124 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:08.119125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:08.119137 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:08.119195 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:08.119380 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.120229 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.121637 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.122140 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.122205 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:08.122260 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:08.122608 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 17:54:08.122649 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":86,"threads_started":1}
I20260808 17:54:08.123073 26857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.118733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33600 (local address 127.28.213.129:40487)
0808 17:54:08.119125 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:08.119128 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:08.119136 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:54:08.119167 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:08.119169 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:08.119183 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:08.119296 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:08.119417 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.120448 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.121686 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.122387 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.122494 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:08.122544 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:08.122948 (+ 404us) server_negotiation.cc:299] Negotiation successful
0808 17:54:08.122991 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":86,"threads_started":1}
I20260808 17:54:08.123071 26860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.118848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44732 (local address 127.28.213.131:41553)
0808 17:54:08.119028 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:08.119032 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:08.119510 (+ 478us) server_negotiation.cc:407] Connection header received
0808 17:54:08.119546 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:08.119548 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:08.119563 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:08.119624 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:08.119799 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.120737 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.121768 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.122393 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.122460 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:08.122512 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:08.122750 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 17:54:08.122991 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":95,"threads_started":1}
I20260808 17:54:08.123382 26856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.118763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:41553 (local address 127.0.0.1:44732)
0808 17:54:08.119392 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:08.119401 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:08.119459 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:08.119686 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:08.119687 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:08.119689 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:08.119725 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:08.119726 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.120818 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.120819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:08.121694 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:08.121697 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.122546 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.122547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:08.122615 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:08.122619 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:54:08.122665 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 17:54:08.122708 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":77,"threads_started":1}
I20260808 17:54:08.123370 26539 tablet_service.cc:1467] Processing CreateTablet for tablet a2045ae7d31a48888f6126d747acf726 (DEFAULT_TABLE table=test-table [id=60df28f588424852b0c65fd060739b83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:54:08.123736 26539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2045ae7d31a48888f6126d747acf726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:08.123688 26325 tablet_service.cc:1467] Processing CreateTablet for tablet a2045ae7d31a48888f6126d747acf726 (DEFAULT_TABLE table=test-table [id=60df28f588424852b0c65fd060739b83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:54:08.124001 26325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2045ae7d31a48888f6126d747acf726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:08.124032 26745 tablet_service.cc:1467] Processing CreateTablet for tablet a2045ae7d31a48888f6126d747acf726 (DEFAULT_TABLE table=test-table [id=60df28f588424852b0c65fd060739b83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:54:08.124338 26745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2045ae7d31a48888f6126d747acf726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:08.126468 26863 tablet_bootstrap.cc:492] T a2045ae7d31a48888f6126d747acf726 P 8c3ed420e40d47afb08750c28dce8557: Bootstrap starting.
I20260808 17:54:08.126945 26866 tablet_bootstrap.cc:492] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6: Bootstrap starting.
I20260808 17:54:08.127187 26863 tablet_bootstrap.cc:654] T a2045ae7d31a48888f6126d747acf726 P 8c3ed420e40d47afb08750c28dce8557: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:08.127571 26866 tablet_bootstrap.cc:654] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:08.127818 26863 log.cc:824] T a2045ae7d31a48888f6126d747acf726 P 8c3ed420e40d47afb08750c28dce8557: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:08.128132 26866 log.cc:824] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:08.128438 26867 tablet_bootstrap.cc:492] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1: Bootstrap starting.
I20260808 17:54:08.128507 26863 tablet_bootstrap.cc:492] T a2045ae7d31a48888f6126d747acf726 P 8c3ed420e40d47afb08750c28dce8557: No bootstrap required, opened a new log
I20260808 17:54:08.128566 26863 ts_tablet_manager.cc:1397] T a2045ae7d31a48888f6126d747acf726 P 8c3ed420e40d47afb08750c28dce8557: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:54:08.128829 26866 tablet_bootstrap.cc:492] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6: No bootstrap required, opened a new log
I20260808 17:54:08.128896 26866 ts_tablet_manager.cc:1397] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:54:08.129078 26867 tablet_bootstrap.cc:654] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:08.129649 26867 log.cc:824] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:08.130152 26863 raft_consensus.cc:348] T a2045ae7d31a48888f6126d747acf726 P 8c3ed420e40d47afb08750c28dce8557 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3ed420e40d47afb08750c28dce8557" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40487 } } peers { permanent_uuid: "03560cef4a9d40809f891a2c50223af1" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 41553 } } peers { permanent_uuid: "df333839c13f41c79906bf2d228f25d6" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 35875 } }
I20260808 17:54:08.130332 26863 raft_consensus.cc:374] T a2045ae7d31a48888f6126d747acf726 P 8c3ed420e40d47afb08750c28dce8557 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:08.130370 26863 raft_consensus.cc:729] T a2045ae7d31a48888f6126d747acf726 P 8c3ed420e40d47afb08750c28dce8557 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3ed420e40d47afb08750c28dce8557, State: Initialized, Role: FOLLOWER
I20260808 17:54:08.130402 26867 tablet_bootstrap.cc:492] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1: No bootstrap required, opened a new log
I20260808 17:54:08.130455 26867 ts_tablet_manager.cc:1397] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:54:08.130487 26863 consensus_queue.cc:260] T a2045ae7d31a48888f6126d747acf726 P 8c3ed420e40d47afb08750c28dce8557 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3ed420e40d47afb08750c28dce8557" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40487 } } peers { permanent_uuid: "03560cef4a9d40809f891a2c50223af1" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 41553 } } peers { permanent_uuid: "df333839c13f41c79906bf2d228f25d6" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 35875 } }
I20260808 17:54:08.130770 26863 ts_tablet_manager.cc:1428] T a2045ae7d31a48888f6126d747acf726 P 8c3ed420e40d47afb08750c28dce8557: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 17:54:08.130788 26432 heartbeater.cc:503] Master 127.28.213.190:36667 was elected leader, sending a full tablet report...
I20260808 17:54:08.130694 26866 raft_consensus.cc:348] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3ed420e40d47afb08750c28dce8557" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40487 } } peers { permanent_uuid: "03560cef4a9d40809f891a2c50223af1" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 41553 } } peers { permanent_uuid: "df333839c13f41c79906bf2d228f25d6" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 35875 } }
I20260808 17:54:08.130861 26866 raft_consensus.cc:374] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:08.130893 26866 raft_consensus.cc:729] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df333839c13f41c79906bf2d228f25d6, State: Initialized, Role: FOLLOWER
I20260808 17:54:08.130995 26866 consensus_queue.cc:260] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3ed420e40d47afb08750c28dce8557" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40487 } } peers { permanent_uuid: "03560cef4a9d40809f891a2c50223af1" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 41553 } } peers { permanent_uuid: "df333839c13f41c79906bf2d228f25d6" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 35875 } }
I20260808 17:54:08.131251 26866 ts_tablet_manager.cc:1428] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:54:08.131376 26643 heartbeater.cc:503] Master 127.28.213.190:36667 was elected leader, sending a full tablet report...
I20260808 17:54:08.132202 26867 raft_consensus.cc:348] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3ed420e40d47afb08750c28dce8557" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40487 } } peers { permanent_uuid: "03560cef4a9d40809f891a2c50223af1" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 41553 } } peers { permanent_uuid: "df333839c13f41c79906bf2d228f25d6" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 35875 } }
I20260808 17:54:08.132355 26867 raft_consensus.cc:374] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:08.132398 26867 raft_consensus.cc:729] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03560cef4a9d40809f891a2c50223af1, State: Initialized, Role: FOLLOWER
I20260808 17:54:08.132503 26867 consensus_queue.cc:260] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3ed420e40d47afb08750c28dce8557" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40487 } } peers { permanent_uuid: "03560cef4a9d40809f891a2c50223af1" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 41553 } } peers { permanent_uuid: "df333839c13f41c79906bf2d228f25d6" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 35875 } }
I20260808 17:54:08.132730 26867 ts_tablet_manager.cc:1428] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 17:54:08.132750 26839 heartbeater.cc:503] Master 127.28.213.190:36667 was elected leader, sending a full tablet report...
W20260808 17:54:08.190727 26645 tablet.cc:2369] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:54:08.281622 26433 tablet.cc:2369] T a2045ae7d31a48888f6126d747acf726 P 8c3ed420e40d47afb08750c28dce8557: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 17:54:08.338330 26840 tablet.cc:2369] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:54:08.398799 26877 raft_consensus.cc:482] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:54:08.398927 26877 raft_consensus.cc:504] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3ed420e40d47afb08750c28dce8557" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40487 } } peers { permanent_uuid: "03560cef4a9d40809f891a2c50223af1" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 41553 } } peers { permanent_uuid: "df333839c13f41c79906bf2d228f25d6" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 35875 } }
I20260808 17:54:08.399296 26877 leader_election.cc:288] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c3ed420e40d47afb08750c28dce8557 (127.28.213.129:40487), 03560cef4a9d40809f891a2c50223af1 (127.28.213.131:41553)
I20260808 17:54:08.402232 26646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.399486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:40487 (local address 127.28.213.130:54931)
0808 17:54:08.399548 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:08.399559 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:08.399607 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:08.399774 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:08.399776 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:08.399778 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:08.399840 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:08.399842 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.400541 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.400542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:08.401479 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:08.401481 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.402003 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.402004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:08.402082 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:08.402086 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:54:08.402138 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 17:54:08.402178 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 17:54:08.402246 26857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.399560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:54931 (local address 127.28.213.129:40487)
0808 17:54:08.399614 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:08.399617 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:08.399631 (+ 14us) server_negotiation.cc:407] Connection header received
0808 17:54:08.399664 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:08.399664 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:08.399674 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:08.399744 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:08.399909 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.400463 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.401560 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.401935 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.401989 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:08.401996 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:08.402147 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 17:54:08.402180 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:54:08.402374 26860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.399663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:38127 (local address 127.28.213.131:41553)
0808 17:54:08.399733 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:08.399736 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:08.399839 (+ 103us) server_negotiation.cc:407] Connection header received
0808 17:54:08.399894 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:08.399895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:08.399906 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:08.399948 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:08.400093 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.400563 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.401655 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.402054 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.402124 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:08.402132 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:08.402275 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 17:54:08.402313 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 17:54:08.402532 26879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.399606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:41553 (local address 127.28.213.130:38127)
0808 17:54:08.399773 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:08.399784 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:08.399834 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:08.399966 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:08.399966 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:08.399968 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:08.400033 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:08.400034 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.400635 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.400635 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:08.401573 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:08.401576 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.402134 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.402135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:08.402202 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:08.402207 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 17:54:08.402259 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 17:54:08.402409 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":110,"threads_started":1}
I20260808 17:54:08.402599 26356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2045ae7d31a48888f6126d747acf726" candidate_uuid: "df333839c13f41c79906bf2d228f25d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3ed420e40d47afb08750c28dce8557" is_pre_election: true
I20260808 17:54:08.402757 26356 raft_consensus.cc:2454] T a2045ae7d31a48888f6126d747acf726 P 8c3ed420e40d47afb08750c28dce8557 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df333839c13f41c79906bf2d228f25d6 in term 0.
I20260808 17:54:08.402846 26775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2045ae7d31a48888f6126d747acf726" candidate_uuid: "df333839c13f41c79906bf2d228f25d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03560cef4a9d40809f891a2c50223af1" is_pre_election: true
I20260808 17:54:08.402989 26775 raft_consensus.cc:2454] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df333839c13f41c79906bf2d228f25d6 in term 0.
I20260808 17:54:08.402989 26461 leader_election.cc:302] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3ed420e40d47afb08750c28dce8557, df333839c13f41c79906bf2d228f25d6; no voters:
I20260808 17:54:08.403097 26877 raft_consensus.cc:2781] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:54:08.403174 26877 raft_consensus.cc:482] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:54:08.403201 26877 raft_consensus.cc:3037] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:08.403891 26877 raft_consensus.cc:504] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3ed420e40d47afb08750c28dce8557" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40487 } } peers { permanent_uuid: "03560cef4a9d40809f891a2c50223af1" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 41553 } } peers { permanent_uuid: "df333839c13f41c79906bf2d228f25d6" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 35875 } }
I20260808 17:54:08.403998 26877 leader_election.cc:288] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [CANDIDATE]: Term 1 election: Requested vote from peers 8c3ed420e40d47afb08750c28dce8557 (127.28.213.129:40487), 03560cef4a9d40809f891a2c50223af1 (127.28.213.131:41553)
I20260808 17:54:08.404187 26775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2045ae7d31a48888f6126d747acf726" candidate_uuid: "df333839c13f41c79906bf2d228f25d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03560cef4a9d40809f891a2c50223af1"
I20260808 17:54:08.404202 26356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2045ae7d31a48888f6126d747acf726" candidate_uuid: "df333839c13f41c79906bf2d228f25d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3ed420e40d47afb08750c28dce8557"
I20260808 17:54:08.404256 26775 raft_consensus.cc:3037] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:08.404268 26356 raft_consensus.cc:3037] T a2045ae7d31a48888f6126d747acf726 P 8c3ed420e40d47afb08750c28dce8557 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:08.404913 26775 raft_consensus.cc:2454] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df333839c13f41c79906bf2d228f25d6 in term 1.
I20260808 17:54:08.404958 26356 raft_consensus.cc:2454] T a2045ae7d31a48888f6126d747acf726 P 8c3ed420e40d47afb08750c28dce8557 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df333839c13f41c79906bf2d228f25d6 in term 1.
I20260808 17:54:08.405061 26461 leader_election.cc:302] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03560cef4a9d40809f891a2c50223af1, df333839c13f41c79906bf2d228f25d6; no voters:
I20260808 17:54:08.405145 26877 raft_consensus.cc:2781] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:08.405326 26877 raft_consensus.cc:686] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [term 1 LEADER]: Becoming Leader. State: Replica: df333839c13f41c79906bf2d228f25d6, State: Running, Role: LEADER
I20260808 17:54:08.405432 26877 consensus_queue.cc:237] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3ed420e40d47afb08750c28dce8557" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40487 } } peers { permanent_uuid: "03560cef4a9d40809f891a2c50223af1" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 41553 } } peers { permanent_uuid: "df333839c13f41c79906bf2d228f25d6" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 35875 } }
I20260808 17:54:08.406190 26125 catalog_manager.cc:5495] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to df333839c13f41c79906bf2d228f25d6 (127.28.213.130). New cstate: current_term: 1 leader_uuid: "df333839c13f41c79906bf2d228f25d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3ed420e40d47afb08750c28dce8557" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03560cef4a9d40809f891a2c50223af1" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df333839c13f41c79906bf2d228f25d6" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 35875 } health_report { overall_health: HEALTHY } } }
I20260808 17:54:08.475045 26861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.472772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45360 (local address 127.28.213.130:35875)
0808 17:54:08.472824 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:08.472826 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:08.472833 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:54:08.472870 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:08.472871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:08.472891 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:08.472955 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:54:08.473079 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.473571 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.474311 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.474522 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.474575 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:08.474720 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:54:08.474830 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:54:08.474897 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:08.474949 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 17:54:08.474969 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 17:54:08.476696 26356 raft_consensus.cc:1261] T a2045ae7d31a48888f6126d747acf726 P 8c3ed420e40d47afb08750c28dce8557 [term 1 FOLLOWER]: Refusing update from remote peer df333839c13f41c79906bf2d228f25d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:54:08.476711 26775 raft_consensus.cc:1261] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1 [term 1 FOLLOWER]: Refusing update from remote peer df333839c13f41c79906bf2d228f25d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:54:08.477038 26880 consensus_queue.cc:1035] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03560cef4a9d40809f891a2c50223af1" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:54:08.477164 26877 consensus_queue.cc:1035] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3ed420e40d47afb08750c28dce8557" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 40487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:54:08.479849 26884 mvcc.cc:205] Tried to move back new op lower bound from 7316322912158138368 to 7316322911869272064. Current Snapshot: MvccSnapshot[applied={T|T < 7316322912158138368}]
I20260808 17:54:08.479912 26885 mvcc.cc:205] Tried to move back new op lower bound from 7316322912158138368 to 7316322911869272064. Current Snapshot: MvccSnapshot[applied={T|T < 7316322912158138368}]
I20260808 17:54:08.480163 26883 mvcc.cc:205] Tried to move back new op lower bound from 7316322912158138368 to 7316322911869272064. Current Snapshot: MvccSnapshot[applied={T|T < 7316322912158138368 or (T in {7316322912158138368})}]
I20260808 17:54:08.481462 26125 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34218:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:54:08.481555 26125 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34218:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:54:08.482276 26125 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 58770aa34f8d406bac27c28b1be98ec1: Sending DeleteTablet for 3 replicas of tablet a2045ae7d31a48888f6126d747acf726
I20260808 17:54:08.482587 26539 tablet_service.cc:1514] Processing DeleteTablet for tablet a2045ae7d31a48888f6126d747acf726 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:54:08 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:45350
I20260808 17:54:08.482647 26745 tablet_service.cc:1514] Processing DeleteTablet for tablet a2045ae7d31a48888f6126d747acf726 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:54:08 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:44732
I20260808 17:54:08.482851 26899 tablet_replica.cc:330] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1: stopping tablet replica
I20260808 17:54:08.482860 26325 tablet_service.cc:1514] Processing DeleteTablet for tablet a2045ae7d31a48888f6126d747acf726 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:54:08 UTC) from {username='kudu', principal='kudu/127.28.213.190@KRBTEST.COM'} at 127.0.0.1:33600
I20260808 17:54:08.482960 26899 raft_consensus.cc:2229] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:54:08.483067 26899 raft_consensus.cc:2258] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:54:08.483078 26902 tablet_replica.cc:330] T a2045ae7d31a48888f6126d747acf726 P 8c3ed420e40d47afb08750c28dce8557: stopping tablet replica
I20260808 17:54:08.483242 26902 raft_consensus.cc:2229] T a2045ae7d31a48888f6126d747acf726 P 8c3ed420e40d47afb08750c28dce8557 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:54:08.483281 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 26221
I20260808 17:54:08.483439 26902 raft_consensus.cc:2258] T a2045ae7d31a48888f6126d747acf726 P 8c3ed420e40d47afb08750c28dce8557 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:54:08.483517 26899 ts_tablet_manager.cc:1905] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:54:08.485306 26899 ts_tablet_manager.cc:1918] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:54:08.485404 26899 log.cc:1196] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/a2045ae7d31a48888f6126d747acf726
I20260808 17:54:08.485669 26899 ts_tablet_manager.cc:1939] T a2045ae7d31a48888f6126d747acf726 P 03560cef4a9d40809f891a2c50223af1: Deleting consensus metadata
I20260808 17:54:08.486037 26104 catalog_manager.cc:4841] TS 03560cef4a9d40809f891a2c50223af1 (127.28.213.131:41553): tablet a2045ae7d31a48888f6126d747acf726 (table test-table [id=60df28f588424852b0c65fd060739b83]) successfully deleted
I20260808 17:54:08.491645 26900 tablet_replica.cc:330] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6: stopping tablet replica
I20260808 17:54:08.491753 26900 raft_consensus.cc:2229] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:54:08.491847 26900 raft_consensus.cc:2258] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:54:08.492431 26900 ts_tablet_manager.cc:1905] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:54:08.493695 26900 ts_tablet_manager.cc:1918] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:54:08.493762 26900 log.cc:1196] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/a2045ae7d31a48888f6126d747acf726
I20260808 17:54:08.493974 26900 ts_tablet_manager.cc:1939] T a2045ae7d31a48888f6126d747acf726 P df333839c13f41c79906bf2d228f25d6: Deleting consensus metadata
I20260808 17:54:08.494340 26107 catalog_manager.cc:4841] TS df333839c13f41c79906bf2d228f25d6 (127.28.213.130:35875): tablet a2045ae7d31a48888f6126d747acf726 (table test-table [id=60df28f588424852b0c65fd060739b83]) successfully deleted
W20260808 17:54:08.497283 26104 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.213.129:40487 (error 108)
I20260808 17:54:08.497566 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 26440
I20260808 17:54:08.497717 26856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.497606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:40487 (local address 127.0.0.1:33614)
0808 17:54:08.497653 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:08.497689 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.129:40487: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 17:54:08.502830 26104 catalog_manager.cc:4584] TS 8c3ed420e40d47afb08750c28dce8557 (127.28.213.129:40487): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a2045ae7d31a48888f6126d747acf726: Network error: Client connection negotiation failed: client connection to 127.28.213.129:40487: connect: Connection refused (error 111)
I20260808 17:54:08.506392 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 26652
I20260808 17:54:08.513581 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 26078
2026-08-08T17:54:08Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2297 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T17:54:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:08Z Disabled control of system clock
I20260808 17:54:08.543838 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:39719
--webserver_interface=127.28.213.190
--webserver_port=0
--builtin_ntp_servers=127.28.213.148:42285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:39719
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 17:54:08.622730 26907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:08.622941 26907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:08.622960 26907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:08.624065 26907 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:08.624104 26907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:08.624115 26907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:08.624130 26907 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:08.624153 26907 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:08.625471 26907 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:42285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:39719
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:39719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:08.625686 26907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:08.625962 26907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 17:54:08.630436 26907 server_base.cc:1034] running on GCE node
W20260808 17:54:08.630460 26914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:08.630414 26917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:08.630430 26913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:08.630885 26907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:08.631147 26907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:08.632285 26907 hybrid_clock.cc:648] HybridClock initialized: now 1786211648632269 us; error 29 us; skew 500 ppm
I20260808 17:54:08.633456 26907 webserver.cc:460] Webserver started at http://127.28.213.190:39869/ using document root <none> and password file <none>
I20260808 17:54:08.633672 26907 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:08.633718 26907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:08.633845 26907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:08.634869 26907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "a5e6315367394ef493ff95996a0a8ad5"
format_stamp: "Formatted at 2026-08-08 17:54:08 on dist-test-slave-bndk"
server_key: "f698192931b721c6e9d7630d2e2a38ab"
server_key_iv: "89448eab5d4ab9781bf55316b55a2eae"
server_key_version: "encryptionkey@0"
I20260808 17:54:08.635198 26907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "a5e6315367394ef493ff95996a0a8ad5"
format_stamp: "Formatted at 2026-08-08 17:54:08 on dist-test-slave-bndk"
server_key: "f698192931b721c6e9d7630d2e2a38ab"
server_key_iv: "89448eab5d4ab9781bf55316b55a2eae"
server_key_version: "encryptionkey@0"
I20260808 17:54:08.636369 26907 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:54:08.637022 26928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:08.637169 26907 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:54:08.637274 26907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "a5e6315367394ef493ff95996a0a8ad5"
format_stamp: "Formatted at 2026-08-08 17:54:08 on dist-test-slave-bndk"
server_key: "f698192931b721c6e9d7630d2e2a38ab"
server_key_iv: "89448eab5d4ab9781bf55316b55a2eae"
server_key_version: "encryptionkey@0"
I20260808 17:54:08.637341 26907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:08.652300 26907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:08.652578 26907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:08.652705 26907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:08.656328 26907 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:39719
I20260808 17:54:08.656380 27016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:39719 every 8 connection(s)
I20260808 17:54:08.656692 26907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:08.657616 27018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:08.657863 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 26907
I20260808 17:54:08.657959 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:08.658149 29526 external_mini_cluster.cc:1428] Setting key dcb233031b9d0becc3fd492704001281
I20260808 17:54:08.660578 27018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5: Bootstrap starting.
I20260808 17:54:08.661265 27018 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:08.661540 27018 log.cc:824] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:08.662155 27018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5: No bootstrap required, opened a new log
I20260808 17:54:08.663683 27021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.658620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57286 (local address 127.28.213.190:39719)
0808 17:54:08.658838 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:08.658847 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:08.658881 (+ 34us) server_negotiation.cc:407] Connection header received
0808 17:54:08.659378 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:08.659388 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:08.659480 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:08.659625 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:08.659783 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.661087 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.661935 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.662352 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.662460 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:08.663122 (+ 662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:08.663126 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:08.663126 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:08.663274 (+ 148us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:08.663304 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:08.663314 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:08.663367 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:08.663457 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 17:54:08.663534 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":75,"threads_started":1}
I20260808 17:54:08.664095 27018 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5e6315367394ef493ff95996a0a8ad5" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39719 } }
I20260808 17:54:08.664252 27018 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:08.664296 27018 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5e6315367394ef493ff95996a0a8ad5, State: Initialized, Role: FOLLOWER
I20260808 17:54:08.664403 27018 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5e6315367394ef493ff95996a0a8ad5" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39719 } }
I20260808 17:54:08.664467 27018 raft_consensus.cc:388] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:08.664496 27018 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:08.664543 27018 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:08.665021 27018 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5e6315367394ef493ff95996a0a8ad5" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39719 } }
I20260808 17:54:08.665114 27018 leader_election.cc:302] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a5e6315367394ef493ff95996a0a8ad5; no voters:
I20260808 17:54:08.665302 27018 leader_election.cc:288] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:08.665337 27028 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:08.665510 27028 raft_consensus.cc:686] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5 [term 1 LEADER]: Becoming Leader. State: Replica: a5e6315367394ef493ff95996a0a8ad5, State: Running, Role: LEADER
I20260808 17:54:08.665536 27018 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:08.665601 27028 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5e6315367394ef493ff95996a0a8ad5" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39719 } }
I20260808 17:54:08.665959 27033 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5e6315367394ef493ff95996a0a8ad5. Latest consensus state: current_term: 1 leader_uuid: "a5e6315367394ef493ff95996a0a8ad5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5e6315367394ef493ff95996a0a8ad5" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39719 } } }
I20260808 17:54:08.666061 27033 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:08.665956 27032 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a5e6315367394ef493ff95996a0a8ad5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5e6315367394ef493ff95996a0a8ad5" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39719 } } }
I20260808 17:54:08.666189 27032 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5 [sys.catalog]: This master's current role is: LEADER
W20260808 17:54:08.667197 27055 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:54:08.667239 27055 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:54:08.667299 27041 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:08.667491 27041 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:08.668797 27041 catalog_manager.cc:1347] Generated new cluster ID: 45099b75f85446ffbe1e043defa7890e
I20260808 17:54:08.668840 27041 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:08.679615 27041 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:08.680090 27041 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:08.686028 27041 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5: Generated new TSK 0
I20260808 17:54:08.686169 27041 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:08.690583 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.129:0
--local_ip_for_outbound_sockets=127.28.213.129
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:39719
--builtin_ntp_servers=127.28.213.148:42285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 17:54:08.771116 27058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:08.771325 27058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:08.771347 27058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:08.772457 27058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:08.772495 27058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:08.772518 27058 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.129
I20260808 17:54:08.773870 27058 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:42285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.213.129
--webserver_port=0
--tserver_master_addrs=127.28.213.190:39719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.129
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:08.774088 27058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:08.774366 27058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:08.778931 27068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:08.779052 27071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:08.778934 27066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:08.779119 27058 server_base.cc:1034] running on GCE node
I20260808 17:54:08.779368 27058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:08.779589 27058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:08.780737 27058 hybrid_clock.cc:648] HybridClock initialized: now 1786211648780727 us; error 25 us; skew 500 ppm
I20260808 17:54:08.781961 27058 webserver.cc:460] Webserver started at http://127.28.213.129:35373/ using document root <none> and password file <none>
I20260808 17:54:08.782174 27058 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:08.782217 27058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:08.782337 27058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:08.783332 27058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-0/data/instance:
uuid: "eb8da8b6d3564cbe887b2b22bcf8711f"
format_stamp: "Formatted at 2026-08-08 17:54:08 on dist-test-slave-bndk"
server_key: "2b7ff04eb3cf6ffce8f6338fd37dbda8"
server_key_iv: "1591530ca6550c288403c473897cb5c2"
server_key_version: "encryptionkey@0"
I20260808 17:54:08.783658 27058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance:
uuid: "eb8da8b6d3564cbe887b2b22bcf8711f"
format_stamp: "Formatted at 2026-08-08 17:54:08 on dist-test-slave-bndk"
server_key: "2b7ff04eb3cf6ffce8f6338fd37dbda8"
server_key_iv: "1591530ca6550c288403c473897cb5c2"
server_key_version: "encryptionkey@0"
I20260808 17:54:08.784858 27058 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:54:08.785609 27080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:08.785770 27058 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:08.785853 27058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-0/wal
uuid: "eb8da8b6d3564cbe887b2b22bcf8711f"
format_stamp: "Formatted at 2026-08-08 17:54:08 on dist-test-slave-bndk"
server_key: "2b7ff04eb3cf6ffce8f6338fd37dbda8"
server_key_iv: "1591530ca6550c288403c473897cb5c2"
server_key_version: "encryptionkey@0"
I20260808 17:54:08.785933 27058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:08.798352 27058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:08.798597 27058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:08.798718 27058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:08.798906 27058 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:54:08.799196 27058 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:54:08.799230 27058 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:08.799255 27058 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:54:08.799279 27058 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:08.804666 27058 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.129:45371
I20260808 17:54:08.804708 27255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.129:45371 every 8 connection(s)
I20260808 17:54:08.805002 27058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-0/data/info.pb
I20260808 17:54:08.805881 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 27058
I20260808 17:54:08.805979 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-0/wal/instance
I20260808 17:54:08.806156 29526 external_mini_cluster.cc:1428] Setting key 0155da6499e545d6c2dc19a5f9579782
I20260808 17:54:08.807039 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.130:0
--local_ip_for_outbound_sockets=127.28.213.130
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:39719
--builtin_ntp_servers=127.28.213.148:42285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 17:54:08.810216 27021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.805677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.129:42763 (local address 127.28.213.190:39719)
0808 17:54:08.805741 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:08.805743 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:08.805977 (+ 234us) server_negotiation.cc:407] Connection header received
0808 17:54:08.806504 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:08.806505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:08.806514 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:08.806562 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:08.807312 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.807979 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.808894 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.809106 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.809162 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:08.809955 (+ 793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:08.809957 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:08.809957 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:08.809961 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:08.809976 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:08.809980 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:08.810026 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:08.810099 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 17:54:08.810138 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 17:54:08.810441 27259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.805643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:39719 (local address 127.28.213.129:42763)
0808 17:54:08.805818 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:08.805857 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:08.806414 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:08.806645 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:08.806649 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:08.806659 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:08.807225 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:08.807231 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.808060 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.808061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:08.808814 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:08.808816 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.809180 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.809181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:08.809336 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:08.809817 (+ 481us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:54:08.809817 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:08.809845 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:54:08.809868 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:08.810032 (+ 164us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:08.810036 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:08.810039 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:54:08.810101 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 17:54:08.810196 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":81,"threads_started":1}
I20260808 17:54:08.810873 27256 heartbeater.cc:347] Connected to a master server at 127.28.213.190:39719
I20260808 17:54:08.810983 27256 heartbeater.cc:464] Registering TS with master...
I20260808 17:54:08.811167 27256 heartbeater.cc:511] Master 127.28.213.190:39719 requested a full tablet report, sending...
I20260808 17:54:08.811663 26955 ts_manager.cc:194] Registered new tserver with Master: eb8da8b6d3564cbe887b2b22bcf8711f (127.28.213.129:45371)
I20260808 17:54:08.812248 26955 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.213.129:42763
W20260808 17:54:08.886374 27261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:08.886552 27261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:08.886571 27261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:08.887673 27261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:08.887713 27261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:08.887737 27261 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.130
I20260808 17:54:08.889097 27261 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:42285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.213.130
--webserver_port=0
--tserver_master_addrs=127.28.213.190:39719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27261
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.130
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:08.889323 27261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:08.889569 27261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:08.893981 27273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:08.894039 27270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:08.894109 27271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:08.894294 27261 server_base.cc:1034] running on GCE node
I20260808 17:54:08.894467 27261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:08.894687 27261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:08.895821 27261 hybrid_clock.cc:648] HybridClock initialized: now 1786211648895809 us; error 23 us; skew 500 ppm
I20260808 17:54:08.896906 27261 webserver.cc:460] Webserver started at http://127.28.213.130:38355/ using document root <none> and password file <none>
I20260808 17:54:08.897118 27261 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:08.897166 27261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:08.897321 27261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:08.898279 27261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-1/data/instance:
uuid: "98d5716b14fe410dad01aa0d12c240a9"
format_stamp: "Formatted at 2026-08-08 17:54:08 on dist-test-slave-bndk"
server_key: "e014fbc49a63019564d4076f082fc5ac"
server_key_iv: "34f065759546b5b73fd50858fd90fa38"
server_key_version: "encryptionkey@0"
I20260808 17:54:08.898593 27261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance:
uuid: "98d5716b14fe410dad01aa0d12c240a9"
format_stamp: "Formatted at 2026-08-08 17:54:08 on dist-test-slave-bndk"
server_key: "e014fbc49a63019564d4076f082fc5ac"
server_key_iv: "34f065759546b5b73fd50858fd90fa38"
server_key_version: "encryptionkey@0"
I20260808 17:54:08.899734 27261 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:54:08.900364 27286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:08.900512 27261 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:08.900590 27261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-1/wal
uuid: "98d5716b14fe410dad01aa0d12c240a9"
format_stamp: "Formatted at 2026-08-08 17:54:08 on dist-test-slave-bndk"
server_key: "e014fbc49a63019564d4076f082fc5ac"
server_key_iv: "34f065759546b5b73fd50858fd90fa38"
server_key_version: "encryptionkey@0"
I20260808 17:54:08.900656 27261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:08.925731 27261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:08.925984 27261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:08.926108 27261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:08.926317 27261 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:54:08.926613 27261 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:54:08.926647 27261 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:08.926676 27261 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:54:08.926693 27261 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:08.931993 27261 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.130:34985
I20260808 17:54:08.932047 27456 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.130:34985 every 8 connection(s)
I20260808 17:54:08.932318 27261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-1/data/info.pb
I20260808 17:54:08.932461 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 27261
I20260808 17:54:08.932551 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-1/wal/instance
I20260808 17:54:08.932767 29526 external_mini_cluster.cc:1428] Setting key ca3ed1eeb0492bbf4efe2d452205ef86
I20260808 17:54:08.933712 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.213.131:0
--local_ip_for_outbound_sockets=127.28.213.131
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:39719
--builtin_ntp_servers=127.28.213.148:42285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 17:54:08.937840 27021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.932946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:48099 (local address 127.28.213.190:39719)
0808 17:54:08.932997 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:08.932999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:08.933254 (+ 255us) server_negotiation.cc:407] Connection header received
0808 17:54:08.933800 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:08.933801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:08.933814 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:08.933884 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:08.934549 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.935209 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.936531 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.936749 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.936801 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:08.937630 (+ 829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:08.937631 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:08.937631 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:08.937635 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:08.937649 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:08.937652 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:08.937691 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:08.937755 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 17:54:08.937781 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:54:08.938097 27460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:08.932946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:39719 (local address 127.28.213.130:48099)
0808 17:54:08.933126 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:08.933167 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:08.933705 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:08.933984 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:08.933987 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:08.933996 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:08.934469 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:08.934473 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.935300 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.935301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:08.936461 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:08.936464 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:08.936828 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:08.936829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:08.936978 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:08.937491 (+ 513us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:54:08.937492 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:08.937528 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:54:08.937554 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:08.937694 (+ 140us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:08.937697 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:08.937700 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:54:08.937755 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 17:54:08.937857 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":78,"threads_started":1}
I20260808 17:54:08.938638 27457 heartbeater.cc:347] Connected to a master server at 127.28.213.190:39719
I20260808 17:54:08.938724 27457 heartbeater.cc:464] Registering TS with master...
I20260808 17:54:08.938890 27457 heartbeater.cc:511] Master 127.28.213.190:39719 requested a full tablet report, sending...
I20260808 17:54:08.939239 26955 ts_manager.cc:194] Registered new tserver with Master: 98d5716b14fe410dad01aa0d12c240a9 (127.28.213.130:34985)
I20260808 17:54:08.939627 26955 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.213.130:48099
W20260808 17:54:09.014704 27461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:09.014889 27461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:09.014909 27461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:09.015997 27461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:09.016036 27461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:09.016062 27461 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.213.131
I20260808 17:54:09.017391 27461 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:42285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.213.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.213.131
--webserver_port=0
--tserver_master_addrs=127.28.213.190:39719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.213.131
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:09.017611 27461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:09.017871 27461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:09.022329 27474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:09.022341 27470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:09.022356 27471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:09.022594 27461 server_base.cc:1034] running on GCE node
I20260808 17:54:09.022770 27461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:09.022979 27461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:09.024106 27461 hybrid_clock.cc:648] HybridClock initialized: now 1786211649024095 us; error 27 us; skew 500 ppm
I20260808 17:54:09.025236 27461 webserver.cc:460] Webserver started at http://127.28.213.131:41877/ using document root <none> and password file <none>
I20260808 17:54:09.025446 27461 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:09.025491 27461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:09.025593 27461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:09.026517 27461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-2/data/instance:
uuid: "bba9f5ff354742afa1fd05bf1ccae479"
format_stamp: "Formatted at 2026-08-08 17:54:09 on dist-test-slave-bndk"
server_key: "200d7ef83bdd383d22563ccb6f9e775f"
server_key_iv: "2d0854f7c67c06f92d029450c79d0609"
server_key_version: "encryptionkey@0"
I20260808 17:54:09.026795 27461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance:
uuid: "bba9f5ff354742afa1fd05bf1ccae479"
format_stamp: "Formatted at 2026-08-08 17:54:09 on dist-test-slave-bndk"
server_key: "200d7ef83bdd383d22563ccb6f9e775f"
server_key_iv: "2d0854f7c67c06f92d029450c79d0609"
server_key_version: "encryptionkey@0"
I20260808 17:54:09.027976 27461 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:54:09.028559 27482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:09.028697 27461 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:09.028774 27461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-2/wal
uuid: "bba9f5ff354742afa1fd05bf1ccae479"
format_stamp: "Formatted at 2026-08-08 17:54:09 on dist-test-slave-bndk"
server_key: "200d7ef83bdd383d22563ccb6f9e775f"
server_key_iv: "2d0854f7c67c06f92d029450c79d0609"
server_key_version: "encryptionkey@0"
I20260808 17:54:09.028826 27461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:09.048926 27461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:09.049140 27461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:09.049280 27461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:09.049461 27461 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 17:54:09.049746 27461 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 17:54:09.049777 27461 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:09.049805 27461 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 17:54:09.049829 27461 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:09.055130 27461 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.131:39381
I20260808 17:54:09.055192 27655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.131:39381 every 8 connection(s)
I20260808 17:54:09.055483 27461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-2/data/info.pb
I20260808 17:54:09.059629 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 27461
I20260808 17:54:09.059715 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-2/wal/instance
I20260808 17:54:09.059890 29526 external_mini_cluster.cc:1428] Setting key 0a2754d211f71217087c16e145b45d75
I20260808 17:54:09.060462 27021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:09.056143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.131:45375 (local address 127.28.213.190:39719)
0808 17:54:09.056189 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:09.056191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:09.056402 (+ 211us) server_negotiation.cc:407] Connection header received
0808 17:54:09.056865 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:09.056867 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:09.056879 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:09.056927 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:09.057616 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.058097 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.059020 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.059206 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.059262 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:09.060203 (+ 941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:09.060205 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:09.060205 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:09.060209 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:09.060224 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:09.060228 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:09.060263 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:09.060343 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 17:54:09.060377 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:54:09.060667 27660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:09.056115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:39719 (local address 127.28.213.131:45375)
0808 17:54:09.056294 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:09.056325 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:09.056773 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:09.057006 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:09.057010 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:09.057019 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:09.057531 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:09.057536 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.058180 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.058181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:09.058938 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:09.058940 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.059278 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.059278 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:09.059399 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:09.060042 (+ 643us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 17:54:09.060043 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:09.060079 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 17:54:09.060101 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:09.060268 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:09.060274 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:09.060277 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:54:09.060341 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 17:54:09.060457 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":80,"threads_started":1}
I20260808 17:54:09.061015 27656 heartbeater.cc:347] Connected to a master server at 127.28.213.190:39719
I20260808 17:54:09.061091 27656 heartbeater.cc:464] Registering TS with master...
I20260808 17:54:09.061291 27656 heartbeater.cc:511] Master 127.28.213.190:39719 requested a full tablet report, sending...
I20260808 17:54:09.061625 26955 ts_manager.cc:194] Registered new tserver with Master: bba9f5ff354742afa1fd05bf1ccae479 (127.28.213.131:39381)
I20260808 17:54:09.061944 26955 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.213.131:45375
I20260808 17:54:09.071470 29526 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 17:54:09.075059 27021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:09.072709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57290 (local address 127.28.213.190:39719)
0808 17:54:09.072757 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:09.072758 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:09.072866 (+ 108us) server_negotiation.cc:407] Connection header received
0808 17:54:09.072908 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:09.072909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:09.072917 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:09.072958 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:09.073089 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.073568 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.074234 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.074409 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.074448 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:09.074896 (+ 448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:09.074897 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:09.074897 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:09.074901 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:09.074912 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:09.074915 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:09.074950 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:09.074982 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 17:54:09.074999 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:54:09.076292 26955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57290:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 17:54:09.077834 26955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 17:54:09.083400 27674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:09.079646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:39381 (local address 127.0.0.1:33838)
0808 17:54:09.079960 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:09.079969 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:09.080006 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:09.080282 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:09.080283 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:09.080286 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:09.080330 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:09.080332 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.081257 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.081258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:09.082408 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:09.082411 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.083114 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.083115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:09.083191 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:09.083206 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 17:54:09.083266 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 17:54:09.083320 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":86,"threads_started":1}
I20260808 17:54:09.083474 27677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:09.079867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34966 (local address 127.28.213.129:45371)
0808 17:54:09.080136 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:09.080140 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:09.080148 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:54:09.080184 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:09.080186 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:09.080200 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:09.080296 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:09.080433 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.081539 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.082480 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.083144 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.083248 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:09.083334 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:09.083360 (+ 26us) server_negotiation.cc:299] Negotiation successful
0808 17:54:09.083396 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":84,"threads_started":1}
I20260808 17:54:09.083741 27675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:09.079725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52074 (local address 127.28.213.130:34985)
0808 17:54:09.080064 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:09.080068 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:09.080077 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:54:09.080107 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:09.080108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:09.080120 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:09.080188 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:09.080344 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.081505 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.082726 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.083400 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.083466 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:09.083542 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:09.083627 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 17:54:09.083666 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":90,"threads_started":1}
I20260808 17:54:09.083747 27676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:09.079834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33838 (local address 127.28.213.131:39381)
0808 17:54:09.080083 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:09.080087 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:09.080096 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:54:09.080130 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:09.080131 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:09.080146 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:09.080214 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:09.080436 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.081163 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.082499 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.083040 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.083103 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:09.083185 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:09.083570 (+ 385us) server_negotiation.cc:299] Negotiation successful
0808 17:54:09.083609 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":62,"threads_started":1}
I20260808 17:54:09.083467 27673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:09.079644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:45371 (local address 127.0.0.1:34966)
0808 17:54:09.079904 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:09.079925 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:09.079977 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:09.080299 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:09.080300 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:09.080302 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:09.080336 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:09.080337 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.081635 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.081637 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:09.082394 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:09.082398 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.083251 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.083252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:09.083304 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:09.083307 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 17:54:09.083343 (+ 36us) client_negotiation.cc:240] Negotiation successful
0808 17:54:09.083374 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":93,"threads_started":1}
I20260808 17:54:09.083715 27672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:09.079639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.130:34985 (local address 127.0.0.1:52074)
0808 17:54:09.079791 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:09.079826 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:09.079897 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:09.080205 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:09.080208 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:09.080210 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:09.080267 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:09.080269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.081597 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.081598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:09.082644 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:09.082646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.083506 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.083507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:09.083563 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:09.083567 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:54:09.083617 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 17:54:09.083652 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":10,"thread_start_us":54,"threads_started":1}
I20260808 17:54:09.084532 27356 tablet_service.cc:1467] Processing CreateTablet for tablet 087d44e6b9b14bb7bdc9a13969477874 (DEFAULT_TABLE table=test-table [id=003328b3a82a448bb7a9e9e111961471]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:54:09.084508 27549 tablet_service.cc:1467] Processing CreateTablet for tablet 087d44e6b9b14bb7bdc9a13969477874 (DEFAULT_TABLE table=test-table [id=003328b3a82a448bb7a9e9e111961471]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:54:09.084511 27148 tablet_service.cc:1467] Processing CreateTablet for tablet 087d44e6b9b14bb7bdc9a13969477874 (DEFAULT_TABLE table=test-table [id=003328b3a82a448bb7a9e9e111961471]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 17:54:09.084852 27356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 087d44e6b9b14bb7bdc9a13969477874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:09.084851 27148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 087d44e6b9b14bb7bdc9a13969477874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:09.084851 27549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 087d44e6b9b14bb7bdc9a13969477874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:09.087419 27678 tablet_bootstrap.cc:492] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9: Bootstrap starting.
I20260808 17:54:09.087996 27678 tablet_bootstrap.cc:654] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:09.088227 27679 tablet_bootstrap.cc:492] T 087d44e6b9b14bb7bdc9a13969477874 P eb8da8b6d3564cbe887b2b22bcf8711f: Bootstrap starting.
I20260808 17:54:09.088325 27678 log.cc:824] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:09.088828 27679 tablet_bootstrap.cc:654] T 087d44e6b9b14bb7bdc9a13969477874 P eb8da8b6d3564cbe887b2b22bcf8711f: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:09.089102 27678 tablet_bootstrap.cc:492] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9: No bootstrap required, opened a new log
I20260808 17:54:09.089120 27679 log.cc:824] T 087d44e6b9b14bb7bdc9a13969477874 P eb8da8b6d3564cbe887b2b22bcf8711f: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:09.089171 27678 ts_tablet_manager.cc:1397] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:54:09.089473 27680 tablet_bootstrap.cc:492] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479: Bootstrap starting.
I20260808 17:54:09.089802 27679 tablet_bootstrap.cc:492] T 087d44e6b9b14bb7bdc9a13969477874 P eb8da8b6d3564cbe887b2b22bcf8711f: No bootstrap required, opened a new log
I20260808 17:54:09.089860 27679 ts_tablet_manager.cc:1397] T 087d44e6b9b14bb7bdc9a13969477874 P eb8da8b6d3564cbe887b2b22bcf8711f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:54:09.090087 27680 tablet_bootstrap.cc:654] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:09.090382 27680 log.cc:824] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:09.091209 27680 tablet_bootstrap.cc:492] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479: No bootstrap required, opened a new log
I20260808 17:54:09.091297 27680 ts_tablet_manager.cc:1397] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 17:54:09.091631 27678 raft_consensus.cc:348] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d5716b14fe410dad01aa0d12c240a9" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 34985 } } peers { permanent_uuid: "bba9f5ff354742afa1fd05bf1ccae479" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39381 } } peers { permanent_uuid: "eb8da8b6d3564cbe887b2b22bcf8711f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45371 } }
I20260808 17:54:09.091802 27678 raft_consensus.cc:374] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:09.091847 27678 raft_consensus.cc:729] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98d5716b14fe410dad01aa0d12c240a9, State: Initialized, Role: FOLLOWER
I20260808 17:54:09.091979 27678 consensus_queue.cc:260] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d5716b14fe410dad01aa0d12c240a9" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 34985 } } peers { permanent_uuid: "bba9f5ff354742afa1fd05bf1ccae479" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39381 } } peers { permanent_uuid: "eb8da8b6d3564cbe887b2b22bcf8711f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45371 } }
I20260808 17:54:09.092015 27679 raft_consensus.cc:348] T 087d44e6b9b14bb7bdc9a13969477874 P eb8da8b6d3564cbe887b2b22bcf8711f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d5716b14fe410dad01aa0d12c240a9" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 34985 } } peers { permanent_uuid: "bba9f5ff354742afa1fd05bf1ccae479" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39381 } } peers { permanent_uuid: "eb8da8b6d3564cbe887b2b22bcf8711f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45371 } }
I20260808 17:54:09.092164 27679 raft_consensus.cc:374] T 087d44e6b9b14bb7bdc9a13969477874 P eb8da8b6d3564cbe887b2b22bcf8711f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:09.092209 27679 raft_consensus.cc:729] T 087d44e6b9b14bb7bdc9a13969477874 P eb8da8b6d3564cbe887b2b22bcf8711f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb8da8b6d3564cbe887b2b22bcf8711f, State: Initialized, Role: FOLLOWER
I20260808 17:54:09.092247 27678 ts_tablet_manager.cc:1428] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:54:09.092367 27457 heartbeater.cc:503] Master 127.28.213.190:39719 was elected leader, sending a full tablet report...
I20260808 17:54:09.092338 27679 consensus_queue.cc:260] T 087d44e6b9b14bb7bdc9a13969477874 P eb8da8b6d3564cbe887b2b22bcf8711f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d5716b14fe410dad01aa0d12c240a9" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 34985 } } peers { permanent_uuid: "bba9f5ff354742afa1fd05bf1ccae479" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39381 } } peers { permanent_uuid: "eb8da8b6d3564cbe887b2b22bcf8711f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45371 } }
I20260808 17:54:09.092592 27679 ts_tablet_manager.cc:1428] T 087d44e6b9b14bb7bdc9a13969477874 P eb8da8b6d3564cbe887b2b22bcf8711f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:54:09.092618 27256 heartbeater.cc:503] Master 127.28.213.190:39719 was elected leader, sending a full tablet report...
I20260808 17:54:09.093639 27680 raft_consensus.cc:348] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d5716b14fe410dad01aa0d12c240a9" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 34985 } } peers { permanent_uuid: "bba9f5ff354742afa1fd05bf1ccae479" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39381 } } peers { permanent_uuid: "eb8da8b6d3564cbe887b2b22bcf8711f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45371 } }
I20260808 17:54:09.093767 27680 raft_consensus.cc:374] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:09.093788 27680 raft_consensus.cc:729] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bba9f5ff354742afa1fd05bf1ccae479, State: Initialized, Role: FOLLOWER
I20260808 17:54:09.093892 27680 consensus_queue.cc:260] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d5716b14fe410dad01aa0d12c240a9" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 34985 } } peers { permanent_uuid: "bba9f5ff354742afa1fd05bf1ccae479" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39381 } } peers { permanent_uuid: "eb8da8b6d3564cbe887b2b22bcf8711f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45371 } }
I20260808 17:54:09.094115 27680 ts_tablet_manager.cc:1428] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 17:54:09.094154 27656 heartbeater.cc:503] Master 127.28.213.190:39719 was elected leader, sending a full tablet report...
I20260808 17:54:09.134018 27691 raft_consensus.cc:482] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 17:54:09.134132 27691 raft_consensus.cc:504] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d5716b14fe410dad01aa0d12c240a9" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 34985 } } peers { permanent_uuid: "bba9f5ff354742afa1fd05bf1ccae479" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39381 } } peers { permanent_uuid: "eb8da8b6d3564cbe887b2b22bcf8711f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45371 } }
I20260808 17:54:09.134492 27691 leader_election.cc:288] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bba9f5ff354742afa1fd05bf1ccae479 (127.28.213.131:39381), eb8da8b6d3564cbe887b2b22bcf8711f (127.28.213.129:45371)
I20260808 17:54:09.138096 27676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:09.134680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:49465 (local address 127.28.213.131:39381)
0808 17:54:09.134717 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:09.134719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:09.134727 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:54:09.134805 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:09.134806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:09.134815 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:09.134875 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:09.135021 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.135784 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.137190 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.137752 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.137824 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:09.137832 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:09.137988 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 17:54:09.138026 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:54:09.138096 27677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:09.134708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.213.130:51577 (local address 127.28.213.129:45371)
0808 17:54:09.134750 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:09.134752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:09.134848 (+ 96us) server_negotiation.cc:407] Connection header received
0808 17:54:09.134886 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:09.134887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:09.134897 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:09.134942 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 17:54:09.135063 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.135753 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.137190 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.137750 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.137825 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:09.137832 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:09.137988 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 17:54:09.138025 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:54:09.138124 27460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:09.134631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.131:39381 (local address 127.28.213.130:49465)
0808 17:54:09.134686 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:09.134697 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:09.134738 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:09.134883 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:09.134883 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:09.134885 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:09.134961 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:09.134962 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.135855 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.135855 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:09.137114 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:09.137118 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.137823 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.137824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:09.137920 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:09.137924 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 17:54:09.137978 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 17:54:09.138029 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":58}
I20260808 17:54:09.138129 27697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:09.134658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:45371 (local address 127.28.213.130:51577)
0808 17:54:09.134785 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:09.134794 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:09.134839 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:09.134954 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:09.134955 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:09.134956 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 17:54:09.135006 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:09.135007 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.135819 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.135820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:09.137123 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:09.137124 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.137822 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.137823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:09.137923 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:09.137925 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 17:54:09.137978 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 17:54:09.138027 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":52,"thread_start_us":73,"threads_started":1}
I20260808 17:54:09.138464 27579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "087d44e6b9b14bb7bdc9a13969477874" candidate_uuid: "98d5716b14fe410dad01aa0d12c240a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bba9f5ff354742afa1fd05bf1ccae479" is_pre_election: true
I20260808 17:54:09.138620 27579 raft_consensus.cc:2454] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98d5716b14fe410dad01aa0d12c240a9 in term 0.
I20260808 17:54:09.138697 27182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "087d44e6b9b14bb7bdc9a13969477874" candidate_uuid: "98d5716b14fe410dad01aa0d12c240a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb8da8b6d3564cbe887b2b22bcf8711f" is_pre_election: true
I20260808 17:54:09.138984 27289 leader_election.cc:302] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98d5716b14fe410dad01aa0d12c240a9, bba9f5ff354742afa1fd05bf1ccae479; no voters:
I20260808 17:54:09.138981 27182 raft_consensus.cc:2454] T 087d44e6b9b14bb7bdc9a13969477874 P eb8da8b6d3564cbe887b2b22bcf8711f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98d5716b14fe410dad01aa0d12c240a9 in term 0.
I20260808 17:54:09.139132 27691 raft_consensus.cc:2781] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 17:54:09.139184 27691 raft_consensus.cc:482] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 17:54:09.139205 27691 raft_consensus.cc:3037] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:09.140128 27691 raft_consensus.cc:504] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d5716b14fe410dad01aa0d12c240a9" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 34985 } } peers { permanent_uuid: "bba9f5ff354742afa1fd05bf1ccae479" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39381 } } peers { permanent_uuid: "eb8da8b6d3564cbe887b2b22bcf8711f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45371 } }
I20260808 17:54:09.140237 27691 leader_election.cc:288] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [CANDIDATE]: Term 1 election: Requested vote from peers bba9f5ff354742afa1fd05bf1ccae479 (127.28.213.131:39381), eb8da8b6d3564cbe887b2b22bcf8711f (127.28.213.129:45371)
I20260808 17:54:09.140386 27579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "087d44e6b9b14bb7bdc9a13969477874" candidate_uuid: "98d5716b14fe410dad01aa0d12c240a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bba9f5ff354742afa1fd05bf1ccae479"
I20260808 17:54:09.140398 27182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "087d44e6b9b14bb7bdc9a13969477874" candidate_uuid: "98d5716b14fe410dad01aa0d12c240a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb8da8b6d3564cbe887b2b22bcf8711f"
I20260808 17:54:09.140467 27579 raft_consensus.cc:3037] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:09.140465 27182 raft_consensus.cc:3037] T 087d44e6b9b14bb7bdc9a13969477874 P eb8da8b6d3564cbe887b2b22bcf8711f [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:09.141253 27579 raft_consensus.cc:2454] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98d5716b14fe410dad01aa0d12c240a9 in term 1.
I20260808 17:54:09.141294 27182 raft_consensus.cc:2454] T 087d44e6b9b14bb7bdc9a13969477874 P eb8da8b6d3564cbe887b2b22bcf8711f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98d5716b14fe410dad01aa0d12c240a9 in term 1.
I20260808 17:54:09.141446 27292 leader_election.cc:302] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98d5716b14fe410dad01aa0d12c240a9, eb8da8b6d3564cbe887b2b22bcf8711f; no voters:
I20260808 17:54:09.141566 27691 raft_consensus.cc:2781] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:09.141724 27691 raft_consensus.cc:686] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [term 1 LEADER]: Becoming Leader. State: Replica: 98d5716b14fe410dad01aa0d12c240a9, State: Running, Role: LEADER
I20260808 17:54:09.141816 27691 consensus_queue.cc:237] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d5716b14fe410dad01aa0d12c240a9" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 34985 } } peers { permanent_uuid: "bba9f5ff354742afa1fd05bf1ccae479" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39381 } } peers { permanent_uuid: "eb8da8b6d3564cbe887b2b22bcf8711f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45371 } }
I20260808 17:54:09.142546 26954 catalog_manager.cc:5495] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98d5716b14fe410dad01aa0d12c240a9 (127.28.213.130). New cstate: current_term: 1 leader_uuid: "98d5716b14fe410dad01aa0d12c240a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d5716b14fe410dad01aa0d12c240a9" member_type: VOTER last_known_addr { host: "127.28.213.130" port: 34985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bba9f5ff354742afa1fd05bf1ccae479" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb8da8b6d3564cbe887b2b22bcf8711f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45371 } health_report { overall_health: UNKNOWN } } }
I20260808 17:54:09.158612 27675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:09.156456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52076 (local address 127.28.213.130:34985)
0808 17:54:09.156508 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:09.156510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:09.156519 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:54:09.156570 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:09.156571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:09.156588 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:09.156645 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:54:09.156746 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.157185 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.157935 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:09.158114 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:09.158165 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:09.158300 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:54:09.158395 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:54:09.158462 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:09.158509 (+ 47us) server_negotiation.cc:299] Negotiation successful
0808 17:54:09.158527 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:54:09.160108 27182 raft_consensus.cc:1261] T 087d44e6b9b14bb7bdc9a13969477874 P eb8da8b6d3564cbe887b2b22bcf8711f [term 1 FOLLOWER]: Refusing update from remote peer 98d5716b14fe410dad01aa0d12c240a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:54:09.160116 27579 raft_consensus.cc:1261] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479 [term 1 FOLLOWER]: Refusing update from remote peer 98d5716b14fe410dad01aa0d12c240a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:54:09.160388 27698 consensus_queue.cc:1035] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb8da8b6d3564cbe887b2b22bcf8711f" member_type: VOTER last_known_addr { host: "127.28.213.129" port: 45371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:54:09.160511 27691 consensus_queue.cc:1035] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bba9f5ff354742afa1fd05bf1ccae479" member_type: VOTER last_known_addr { host: "127.28.213.131" port: 39381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:54:09.162657 27701 mvcc.cc:205] Tried to move back new op lower bound from 7316322914957631488 to 7316322914885464064. Current Snapshot: MvccSnapshot[applied={T|T < 7316322914957631488}]
I20260808 17:54:09.163157 27703 mvcc.cc:205] Tried to move back new op lower bound from 7316322914957631488 to 7316322914885464064. Current Snapshot: MvccSnapshot[applied={T|T < 7316322914957631488}]
I20260808 17:54:09.164827 26954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:54:09.164917 26954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 17:54:09.165565 26954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a5e6315367394ef493ff95996a0a8ad5: Sending DeleteTablet for 3 replicas of tablet 087d44e6b9b14bb7bdc9a13969477874
I20260808 17:54:09.165915 27549 tablet_service.cc:1514] Processing DeleteTablet for tablet 087d44e6b9b14bb7bdc9a13969477874 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:54:09 UTC) from {username='slave'} at 127.0.0.1:33838
I20260808 17:54:09.165958 27148 tablet_service.cc:1514] Processing DeleteTablet for tablet 087d44e6b9b14bb7bdc9a13969477874 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:54:09 UTC) from {username='slave'} at 127.0.0.1:34966
I20260808 17:54:09.166157 27716 tablet_replica.cc:330] T 087d44e6b9b14bb7bdc9a13969477874 P eb8da8b6d3564cbe887b2b22bcf8711f: stopping tablet replica
I20260808 17:54:09.166137 27356 tablet_service.cc:1514] Processing DeleteTablet for tablet 087d44e6b9b14bb7bdc9a13969477874 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 17:54:09 UTC) from {username='slave'} at 127.0.0.1:52074
I20260808 17:54:09.166246 27716 raft_consensus.cc:2229] T 087d44e6b9b14bb7bdc9a13969477874 P eb8da8b6d3564cbe887b2b22bcf8711f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:54:09.166349 27716 raft_consensus.cc:2258] T 087d44e6b9b14bb7bdc9a13969477874 P eb8da8b6d3564cbe887b2b22bcf8711f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:54:09.166368 27719 tablet_replica.cc:330] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9: stopping tablet replica
I20260808 17:54:09.166575 27719 raft_consensus.cc:2229] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 17:54:09.166697 27717 tablet_replica.cc:330] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479: stopping tablet replica
I20260808 17:54:09.166730 27719 raft_consensus.cc:2258] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:54:09.166792 27717 raft_consensus.cc:2229] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 17:54:09.166836 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 27058
I20260808 17:54:09.170724 27717 raft_consensus.cc:2258] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 17:54:09.171131 27719 ts_tablet_manager.cc:1905] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:54:09.177114 27717 ts_tablet_manager.cc:1905] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 17:54:09.177132 27719 ts_tablet_manager.cc:1918] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:54:09.177196 27719 log.cc:1196] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-1/wal/wals/087d44e6b9b14bb7bdc9a13969477874
I20260808 17:54:09.177479 27719 ts_tablet_manager.cc:1939] T 087d44e6b9b14bb7bdc9a13969477874 P 98d5716b14fe410dad01aa0d12c240a9: Deleting consensus metadata
I20260808 17:54:09.177884 26935 catalog_manager.cc:4841] TS 98d5716b14fe410dad01aa0d12c240a9 (127.28.213.130:34985): tablet 087d44e6b9b14bb7bdc9a13969477874 (table test-table [id=003328b3a82a448bb7a9e9e111961471]) successfully deleted
I20260808 17:54:09.179283 27717 ts_tablet_manager.cc:1918] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 17:54:09.179358 27717 log.cc:1196] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479: Deleting WAL directory at /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786211411189989-29526-0/minicluster-data/ts-2/wal/wals/087d44e6b9b14bb7bdc9a13969477874
I20260808 17:54:09.179590 27717 ts_tablet_manager.cc:1939] T 087d44e6b9b14bb7bdc9a13969477874 P bba9f5ff354742afa1fd05bf1ccae479: Deleting consensus metadata
I20260808 17:54:09.180001 26934 catalog_manager.cc:4841] TS bba9f5ff354742afa1fd05bf1ccae479 (127.28.213.131:39381): tablet 087d44e6b9b14bb7bdc9a13969477874 (table test-table [id=003328b3a82a448bb7a9e9e111961471]) successfully deleted
W20260808 17:54:09.181008 26936 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.213.129:45371 (error 108)
I20260808 17:54:09.181209 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 27261
I20260808 17:54:09.182948 27674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:09.181377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.129:45371 (local address 127.0.0.1:34972)
0808 17:54:09.182866 (+ 1489us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:09.182913 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.129:45371: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1466}
W20260808 17:54:09.185633 26936 catalog_manager.cc:4584] TS eb8da8b6d3564cbe887b2b22bcf8711f (127.28.213.129:45371): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 087d44e6b9b14bb7bdc9a13969477874: Network error: Client connection negotiation failed: client connection to 127.28.213.129:45371: connect: Connection refused (error 111)
I20260808 17:54:09.198514 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 27461
I20260808 17:54:09.207082 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 26907
2026-08-08T17:54:09Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (693 ms)
[----------] 6 tests from EncryptionPolicyTest (8714 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:09 dist-test-slave-bndk krb5kdc[27726](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:09 dist-test-slave-bndk krb5kdc[27726](info): set up 2 sockets
Aug 08 17:54:09 dist-test-slave-bndk krb5kdc[27726](info): commencing operation
krb5kdc: starting...
W20260808 17:54:10.322878 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:10 dist-test-slave-bndk krb5kdc[27726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:54:10.433523 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34643
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34643
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:10.511969 27744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:10.512161 27744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:10.512189 27744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:10.513304 27744 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:10.513345 27744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:10.513363 27744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:10.513381 27744 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:10.513396 27744 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:10.514815 27744 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34643
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34643
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27744
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:10.515050 27744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:10.515239 27744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:10.519564 27749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:10.519582 27754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:10.519734 27752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:10.519899 27744 server_base.cc:1034] running on GCE node
I20260808 17:54:10.520118 27744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:10.520381 27744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:10.521517 27744 hybrid_clock.cc:648] HybridClock initialized: now 1786211650521499 us; error 28 us; skew 500 ppm
Aug 08 17:54:10 dist-test-slave-bndk krb5kdc[27726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211650, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:10.523790 27744 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:54:10.524188 27744 webserver.cc:460] Webserver started at http://127.0.0.1:43537/ using document root <none> and password file <none>
I20260808 17:54:10.524353 27744 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:10.524392 27744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:10.524482 27744 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:10.525457 27744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "225c062fac7145c4a74a5df98c58811c"
format_stamp: "Formatted at 2026-08-08 17:54:10 on dist-test-slave-bndk"
server_key: "64bf681c4967baf339ff31190ed71152"
server_key_iv: "c9e6f9ab875ea0f0ceb4a326176210ea"
server_key_version: "encryptionkey@0"
I20260808 17:54:10.525758 27744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "225c062fac7145c4a74a5df98c58811c"
format_stamp: "Formatted at 2026-08-08 17:54:10 on dist-test-slave-bndk"
server_key: "64bf681c4967baf339ff31190ed71152"
server_key_iv: "c9e6f9ab875ea0f0ceb4a326176210ea"
server_key_version: "encryptionkey@0"
I20260808 17:54:10.526913 27744 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:54:10.527505 27761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:10.527654 27744 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:10.527733 27744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "225c062fac7145c4a74a5df98c58811c"
format_stamp: "Formatted at 2026-08-08 17:54:10 on dist-test-slave-bndk"
server_key: "64bf681c4967baf339ff31190ed71152"
server_key_iv: "c9e6f9ab875ea0f0ceb4a326176210ea"
server_key_version: "encryptionkey@0"
I20260808 17:54:10.527784 27744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:10.552956 27744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:10.554582 27744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:10.554684 27744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:10.558256 27744 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34643
I20260808 17:54:10.558310 27841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34643 every 8 connection(s)
I20260808 17:54:10.558609 27744 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:10.559407 27844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:10.561635 27844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c: Bootstrap starting.
I20260808 17:54:10.562177 27844 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:10.562440 27844 log.cc:824] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:10.563051 27844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c: No bootstrap required, opened a new log
I20260808 17:54:10.564659 27844 raft_consensus.cc:348] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225c062fac7145c4a74a5df98c58811c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34643 } }
I20260808 17:54:10.564787 27844 raft_consensus.cc:374] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:10.564810 27844 raft_consensus.cc:729] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225c062fac7145c4a74a5df98c58811c, State: Initialized, Role: FOLLOWER
I20260808 17:54:10.564949 27844 consensus_queue.cc:260] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225c062fac7145c4a74a5df98c58811c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34643 } }
I20260808 17:54:10.565009 27844 raft_consensus.cc:388] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:10.565030 27844 raft_consensus.cc:482] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:10.565076 27844 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:10.565582 27844 raft_consensus.cc:504] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225c062fac7145c4a74a5df98c58811c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34643 } }
I20260808 17:54:10.565670 27844 leader_election.cc:302] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 225c062fac7145c4a74a5df98c58811c; no voters:
I20260808 17:54:10.565816 27844 leader_election.cc:288] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:10.565845 27848 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:10.565981 27848 raft_consensus.cc:686] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c [term 1 LEADER]: Becoming Leader. State: Replica: 225c062fac7145c4a74a5df98c58811c, State: Running, Role: LEADER
I20260808 17:54:10.566048 27844 sys_catalog.cc:564] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:10.566071 27848 consensus_queue.cc:237] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225c062fac7145c4a74a5df98c58811c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34643 } }
I20260808 17:54:10.566455 27850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 225c062fac7145c4a74a5df98c58811c. Latest consensus state: current_term: 1 leader_uuid: "225c062fac7145c4a74a5df98c58811c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225c062fac7145c4a74a5df98c58811c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34643 } } }
I20260808 17:54:10.566534 27850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:10.566582 27849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "225c062fac7145c4a74a5df98c58811c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225c062fac7145c4a74a5df98c58811c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34643 } } }
I20260808 17:54:10.566658 27849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:10.566742 27862 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:10.567248 27862 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:10.567580 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 27744
I20260808 17:54:10.567682 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:10.567847 29526 external_mini_cluster.cc:1428] Setting key 4e954236634d90d913d51b3324fd3b78
I20260808 17:54:10.569672 27862 catalog_manager.cc:1347] Generated new cluster ID: 0b84c5fe5854478082df88404590bebb
I20260808 17:54:10.569725 27862 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:54:10 dist-test-slave-bndk krb5kdc[27726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 17:54:10.579324 27874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:10.568263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46211 (local address 127.0.0.1:34643)
0808 17:54:10.568869 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:10.568878 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:10.568912 (+ 34us) server_negotiation.cc:407] Connection header received
0808 17:54:10.569011 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:10.569017 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:10.569056 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:10.569170 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:10.569973 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:10.571428 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:10.572440 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:10.573065 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:10.573177 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:10.575832 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:10.575837 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:10.575837 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:10.575848 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:10.577713 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:10.578170 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:10.578172 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:10.578173 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:10.578267 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:10.578469 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:10.578469 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:10.578469 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:10.578738 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:10.578874 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:10.579006 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 17:54:10.579100 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":76,"threads_started":1}
I20260808 17:54:10.580351 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:10.594635 27874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:10.581797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54043 (local address 127.0.0.1:34643)
0808 17:54:10.581830 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:10.581831 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:10.585378 (+ 3547us) server_negotiation.cc:407] Connection header received
0808 17:54:10.585428 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:10.585429 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:10.585441 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:10.585505 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:10.586053 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:10.586796 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:10.587716 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:10.588044 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:10.588109 (+ 65us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:10.589295 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:10.589297 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:10.589297 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:10.589304 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:10.593545 (+ 4241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:10.593924 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:10.593925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:10.593925 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:10.593981 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:10.594162 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:10.594162 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:10.594163 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:10.594285 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:10.594393 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:10.594480 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 17:54:10.594541 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 17:54:10.595794 27862 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:10.596282 27862 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:10.607370 27862 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 225c062fac7145c4a74a5df98c58811c: Generated new TSK 0
I20260808 17:54:10.607555 27862 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:10.610105 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 27744
W20260808 17:54:10.622960 27724 connection.cc:535] client connection to 127.0.0.1:34643 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34643): Connection reset by peer (error 104)
2026-08-08T17:54:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1406 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:10 dist-test-slave-bndk krb5kdc[27887](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:10 dist-test-slave-bndk krb5kdc[27887](info): set up 2 sockets
Aug 08 17:54:10 dist-test-slave-bndk krb5kdc[27887](info): commencing operation
krb5kdc: starting...
W20260808 17:54:11.729907 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.094s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:11 dist-test-slave-bndk krb5kdc[27887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211651, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:54:11.841157 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43271
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43271
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:11.919682 27912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:11.919876 27912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:11.919909 27912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:11.921005 27912 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:11.921044 27912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:11.921062 27912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:11.921079 27912 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:11.921093 27912 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:11.922535 27912 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43271
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:11.922771 27912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:11.922973 27912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:11.927464 27917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:11.927474 27918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:11.927505 27912 server_base.cc:1034] running on GCE node
W20260808 17:54:11.927505 27923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:11.927881 27912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:11.928164 27912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:11.929265 27912 hybrid_clock.cc:648] HybridClock initialized: now 1786211651929252 us; error 24 us; skew 500 ppm
Aug 08 17:54:11 dist-test-slave-bndk krb5kdc[27887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211651, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:11.931499 27912 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:54:11.931911 27912 webserver.cc:460] Webserver started at http://127.0.0.1:36243/ using document root <none> and password file <none>
I20260808 17:54:11.932121 27912 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:11.932168 27912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:11.932291 27912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:11.933393 27912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "0cab9a22b4a743d8973a87d3fd0582ff"
format_stamp: "Formatted at 2026-08-08 17:54:11 on dist-test-slave-bndk"
server_key: "c5a567e4f2b140f7f5ebd2d4fbf6f88d"
server_key_iv: "a08b7fe3b25bb9c92c978ed671822cb3"
server_key_version: "encryptionkey@0"
I20260808 17:54:11.933712 27912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "0cab9a22b4a743d8973a87d3fd0582ff"
format_stamp: "Formatted at 2026-08-08 17:54:11 on dist-test-slave-bndk"
server_key: "c5a567e4f2b140f7f5ebd2d4fbf6f88d"
server_key_iv: "a08b7fe3b25bb9c92c978ed671822cb3"
server_key_version: "encryptionkey@0"
I20260808 17:54:11.934906 27912 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:54:11.935503 27935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:11.935650 27912 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:11.935730 27912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "0cab9a22b4a743d8973a87d3fd0582ff"
format_stamp: "Formatted at 2026-08-08 17:54:11 on dist-test-slave-bndk"
server_key: "c5a567e4f2b140f7f5ebd2d4fbf6f88d"
server_key_iv: "a08b7fe3b25bb9c92c978ed671822cb3"
server_key_version: "encryptionkey@0"
I20260808 17:54:11.935787 27912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:11.954254 27912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:11.955845 27912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:11.955971 27912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:11.959748 27912 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43271
I20260808 17:54:11.959779 28016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43271 every 8 connection(s)
I20260808 17:54:11.960090 27912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:11.960872 28018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:11.963001 28018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff: Bootstrap starting.
I20260808 17:54:11.963515 28018 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:11.963737 28018 log.cc:824] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:11.964325 28018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff: No bootstrap required, opened a new log
I20260808 17:54:11.965099 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 27912
I20260808 17:54:11.965204 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:11.965404 29526 external_mini_cluster.cc:1428] Setting key ef8f4dced89b6adddfc1f8fed1dcd2a7
I20260808 17:54:11.966073 28018 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cab9a22b4a743d8973a87d3fd0582ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43271 } }
I20260808 17:54:11.966233 28018 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:11.966274 28018 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cab9a22b4a743d8973a87d3fd0582ff, State: Initialized, Role: FOLLOWER
I20260808 17:54:11.966396 28018 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cab9a22b4a743d8973a87d3fd0582ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43271 } }
I20260808 17:54:11.966480 28018 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:11.966519 28018 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:11.966564 28018 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:11.967087 28018 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cab9a22b4a743d8973a87d3fd0582ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43271 } }
I20260808 17:54:11.967173 28018 leader_election.cc:302] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0cab9a22b4a743d8973a87d3fd0582ff; no voters:
I20260808 17:54:11.967310 28018 leader_election.cc:288] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:11.967367 28026 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:11.967547 28018 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:11.967561 28026 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff [term 1 LEADER]: Becoming Leader. State: Replica: 0cab9a22b4a743d8973a87d3fd0582ff, State: Running, Role: LEADER
I20260808 17:54:11.967721 28026 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cab9a22b4a743d8973a87d3fd0582ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43271 } }
I20260808 17:54:11.968073 28028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0cab9a22b4a743d8973a87d3fd0582ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cab9a22b4a743d8973a87d3fd0582ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43271 } } }
I20260808 17:54:11.968145 28028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:11.968343 28029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0cab9a22b4a743d8973a87d3fd0582ff. Latest consensus state: current_term: 1 leader_uuid: "0cab9a22b4a743d8973a87d3fd0582ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cab9a22b4a743d8973a87d3fd0582ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43271 } } }
I20260808 17:54:11.968650 28029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:11.968899 28035 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:11.969616 28035 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:11.971060 28035 catalog_manager.cc:1347] Generated new cluster ID: 805b0d593bbf40b8a2e39f723863a9ef
I20260808 17:54:11.971068 28022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:11.965845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60427 (local address 127.0.0.1:43271)
0808 17:54:11.966049 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:11.966059 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:11.966090 (+ 31us) server_negotiation.cc:407] Connection header received
0808 17:54:11.966197 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:11.966203 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:11.966256 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:11.966390 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:11.966739 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:11.968171 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:11.969281 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:11.969673 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:11.969774 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:11.970481 (+ 707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:11.970486 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:11.970486 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:11.970641 (+ 155us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:11.970670 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:11.970682 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:11.970752 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:11.970842 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 17:54:11.970869 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":102,"threads_started":1}
I20260808 17:54:11.971119 28035 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:11.971913 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:11.975796 28022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:11.973096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47227 (local address 127.0.0.1:43271)
0808 17:54:11.973130 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:11.973132 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:11.973422 (+ 290us) server_negotiation.cc:407] Connection header received
0808 17:54:11.973463 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:11.973463 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:11.973475 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:11.973518 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:11.973632 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:11.974090 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:11.974743 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:11.974966 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:11.975018 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:11.975587 (+ 569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:11.975588 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:11.975588 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:11.975592 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:11.975605 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:11.975609 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:11.975652 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:11.975719 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 17:54:11.975730 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:54:11.987627 28035 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:11.988068 28035 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:11.994706 28035 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0cab9a22b4a743d8973a87d3fd0582ff: Generated new TSK 0
I20260808 17:54:11.994849 28035 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:12.000397 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 27912
W20260808 17:54:12.015642 27885 connection.cc:535] client connection to 127.0.0.1:43271 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43271): Connection reset by peer (error 104)
2026-08-08T17:54:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1392 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:12 dist-test-slave-bndk krb5kdc[28068](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:12 dist-test-slave-bndk krb5kdc[28068](info): set up 2 sockets
Aug 08 17:54:12 dist-test-slave-bndk krb5kdc[28068](info): commencing operation
krb5kdc: starting...
W20260808 17:54:13.121711 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:13 dist-test-slave-bndk krb5kdc[28068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:54:13.230050 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36275
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:13.308043 28097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:13.308231 28097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:13.308262 28097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:13.309387 28097 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:13.309432 28097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:13.309453 28097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:13.309468 28097 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:13.309481 28097 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:13.310915 28097 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36275
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:13.311147 28097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:13.311367 28097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:13.315740 28105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:13.315873 28097 server_base.cc:1034] running on GCE node
W20260808 17:54:13.315781 28106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:13.315742 28110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:13.316161 28097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:13.316422 28097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:13.317554 28097 hybrid_clock.cc:648] HybridClock initialized: now 1786211653317541 us; error 25 us; skew 500 ppm
Aug 08 17:54:13 dist-test-slave-bndk krb5kdc[28068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211653, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:13.319833 28097 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:54:13.320197 28097 webserver.cc:460] Webserver started at http://127.0.0.1:40799/ using document root <none> and password file <none>
I20260808 17:54:13.320366 28097 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:13.320405 28097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:13.320497 28097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:13.321453 28097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "c985a5c3e309483088c517be8091875d"
format_stamp: "Formatted at 2026-08-08 17:54:13 on dist-test-slave-bndk"
server_key: "2a1cbeec1eade0ba0404d6fc93ce6adf"
server_key_iv: "18fc94a430bd75bded312040c8526e52"
server_key_version: "encryptionkey@0"
I20260808 17:54:13.321732 28097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "c985a5c3e309483088c517be8091875d"
format_stamp: "Formatted at 2026-08-08 17:54:13 on dist-test-slave-bndk"
server_key: "2a1cbeec1eade0ba0404d6fc93ce6adf"
server_key_iv: "18fc94a430bd75bded312040c8526e52"
server_key_version: "encryptionkey@0"
I20260808 17:54:13.322860 28097 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:54:13.323477 28118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:13.323622 28097 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:13.323697 28097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "c985a5c3e309483088c517be8091875d"
format_stamp: "Formatted at 2026-08-08 17:54:13 on dist-test-slave-bndk"
server_key: "2a1cbeec1eade0ba0404d6fc93ce6adf"
server_key_iv: "18fc94a430bd75bded312040c8526e52"
server_key_version: "encryptionkey@0"
I20260808 17:54:13.323748 28097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:13.326812 28097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:13.328383 28097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:13.328480 28097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:13.332041 28097 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36275
I20260808 17:54:13.332073 28194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36275 every 8 connection(s)
I20260808 17:54:13.332335 28097 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:13.333256 28196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:13.333590 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 28097
I20260808 17:54:13.333690 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:13.333873 29526 external_mini_cluster.cc:1428] Setting key 003694c63487ca902e2efcd6b9e440f5
I20260808 17:54:13.335790 28196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d: Bootstrap starting.
I20260808 17:54:13.336081 28201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:13.334312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35851 (local address 127.0.0.1:36275)
0808 17:54:13.334476 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:13.334483 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:13.334602 (+ 119us) server_negotiation.cc:407] Connection header received
0808 17:54:13.334997 (+ 395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:13.335003 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:13.335027 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:13.335134 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:13.335701 (+ 567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:13.335704 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:13.335705 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:13.335708 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:13.335742 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:13.335751 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:13.335801 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:13.335919 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 17:54:13.335956 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
I20260808 17:54:13.336494 28196 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:13.336793 28196 log.cc:824] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:13.336969 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:13.337476 28196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d: No bootstrap required, opened a new log
I20260808 17:54:13.339140 28201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:13.338233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51879 (local address 127.0.0.1:36275)
0808 17:54:13.338262 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:13.338263 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:13.338389 (+ 126us) server_negotiation.cc:407] Connection header received
0808 17:54:13.338441 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:13.338442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:13.338446 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:13.338492 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:13.338973 (+ 481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:13.338974 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:13.338974 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:13.338978 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:13.338989 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:13.338992 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:13.339035 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:13.339075 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 17:54:13.339086 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260808 17:54:13.339555 28196 raft_consensus.cc:348] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c985a5c3e309483088c517be8091875d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36275 } }
I20260808 17:54:13.339692 28196 raft_consensus.cc:374] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:13.339715 28196 raft_consensus.cc:729] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c985a5c3e309483088c517be8091875d, State: Initialized, Role: FOLLOWER
I20260808 17:54:13.339823 28196 consensus_queue.cc:260] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c985a5c3e309483088c517be8091875d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36275 } }
I20260808 17:54:13.339892 28196 raft_consensus.cc:388] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:13.339915 28196 raft_consensus.cc:482] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:13.339958 28196 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:13.340452 28196 raft_consensus.cc:504] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c985a5c3e309483088c517be8091875d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36275 } }
I20260808 17:54:13.340539 28196 leader_election.cc:302] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c985a5c3e309483088c517be8091875d; no voters:
I20260808 17:54:13.340689 28196 leader_election.cc:288] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:13.340734 28211 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:13.340874 28211 raft_consensus.cc:686] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d [term 1 LEADER]: Becoming Leader. State: Replica: c985a5c3e309483088c517be8091875d, State: Running, Role: LEADER
I20260808 17:54:13.340893 28196 sys_catalog.cc:564] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:13.340960 28211 consensus_queue.cc:237] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c985a5c3e309483088c517be8091875d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36275 } }
I20260808 17:54:13.341300 28213 sys_catalog.cc:455] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c985a5c3e309483088c517be8091875d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c985a5c3e309483088c517be8091875d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36275 } } }
I20260808 17:54:13.341302 28214 sys_catalog.cc:455] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c985a5c3e309483088c517be8091875d. Latest consensus state: current_term: 1 leader_uuid: "c985a5c3e309483088c517be8091875d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c985a5c3e309483088c517be8091875d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36275 } } }
I20260808 17:54:13.341449 28213 sys_catalog.cc:458] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:13.341483 28214 sys_catalog.cc:458] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:13.342058 28223 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:13.342458 28223 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:13.343828 28223 catalog_manager.cc:1347] Generated new cluster ID: 60c3f6021ed64268a893375f30fdad76
I20260808 17:54:13.343879 28223 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:13.349867 28223 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:13.349994 28223 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:13.355495 28223 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c985a5c3e309483088c517be8091875d: Generated new TSK 0
I20260808 17:54:13.355635 28223 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:13.359194 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 28097
2026-08-08T17:54:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1353 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:13 dist-test-slave-bndk krb5kdc[28238](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:13 dist-test-slave-bndk krb5kdc[28238](info): set up 2 sockets
Aug 08 17:54:13 dist-test-slave-bndk krb5kdc[28238](info): commencing operation
krb5kdc: starting...
W20260808 17:54:14.484077 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:14 dist-test-slave-bndk krb5kdc[28238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:54:14.592486 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34303
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:14.670719 28256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:14.670902 28256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:14.670925 28256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:14.672040 28256 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:14.672081 28256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:14.672094 28256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:14.672117 28256 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:14.672140 28256 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:14.673589 28256 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:14.673802 28256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:14.673992 28256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:14.678406 28269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:14.678416 28275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:14.678540 28256 server_base.cc:1034] running on GCE node
W20260808 17:54:14.678593 28271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:14.678876 28256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:14.679104 28256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:14.680234 28256 hybrid_clock.cc:648] HybridClock initialized: now 1786211654680222 us; error 28 us; skew 500 ppm
Aug 08 17:54:14 dist-test-slave-bndk krb5kdc[28238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211654, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:14.682569 28256 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:54:14.682942 28256 webserver.cc:460] Webserver started at http://127.0.0.1:41603/ using document root <none> and password file <none>
I20260808 17:54:14.683123 28256 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:14.683161 28256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:14.683245 28256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:14.684144 28256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "e0f050d1bbc24370918a812ae15a0d74"
format_stamp: "Formatted at 2026-08-08 17:54:14 on dist-test-slave-bndk"
server_key: "d803f2337f86a1e2fcc89b1dd3dd1b7d"
server_key_iv: "09ce07194a0f3a48b9d269fc39d1ec92"
server_key_version: "encryptionkey@0"
I20260808 17:54:14.684428 28256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "e0f050d1bbc24370918a812ae15a0d74"
format_stamp: "Formatted at 2026-08-08 17:54:14 on dist-test-slave-bndk"
server_key: "d803f2337f86a1e2fcc89b1dd3dd1b7d"
server_key_iv: "09ce07194a0f3a48b9d269fc39d1ec92"
server_key_version: "encryptionkey@0"
I20260808 17:54:14.685580 28256 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:54:14.686195 28293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:14.686338 28256 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:14.686406 28256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "e0f050d1bbc24370918a812ae15a0d74"
format_stamp: "Formatted at 2026-08-08 17:54:14 on dist-test-slave-bndk"
server_key: "d803f2337f86a1e2fcc89b1dd3dd1b7d"
server_key_iv: "09ce07194a0f3a48b9d269fc39d1ec92"
server_key_version: "encryptionkey@0"
I20260808 17:54:14.686476 28256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:14.693176 28256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:14.695166 28256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:14.695287 28256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:14.698971 28256 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34303
I20260808 17:54:14.699009 28383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34303 every 8 connection(s)
I20260808 17:54:14.699303 28256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:14.700145 28384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:14.702256 28384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74: Bootstrap starting.
I20260808 17:54:14.702764 28384 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:14.702999 28384 log.cc:824] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:14.703608 28384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74: No bootstrap required, opened a new log
I20260808 17:54:14.705084 28384 raft_consensus.cc:348] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0f050d1bbc24370918a812ae15a0d74" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34303 } }
I20260808 17:54:14.705209 28384 raft_consensus.cc:374] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:14.705272 28384 raft_consensus.cc:729] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f050d1bbc24370918a812ae15a0d74, State: Initialized, Role: FOLLOWER
I20260808 17:54:14.705389 28384 consensus_queue.cc:260] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0f050d1bbc24370918a812ae15a0d74" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34303 } }
I20260808 17:54:14.705462 28384 raft_consensus.cc:388] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:14.705488 28384 raft_consensus.cc:482] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:14.705519 28384 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:14.705971 28384 raft_consensus.cc:504] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0f050d1bbc24370918a812ae15a0d74" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34303 } }
I20260808 17:54:14.706053 28384 leader_election.cc:302] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e0f050d1bbc24370918a812ae15a0d74; no voters:
I20260808 17:54:14.706175 28384 leader_election.cc:288] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:14.706230 28388 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:14.706285 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 28256
I20260808 17:54:14.706349 28388 raft_consensus.cc:686] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74 [term 1 LEADER]: Becoming Leader. State: Replica: e0f050d1bbc24370918a812ae15a0d74, State: Running, Role: LEADER
I20260808 17:54:14.706389 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:14.706423 28384 sys_catalog.cc:564] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:14.706421 28388 consensus_queue.cc:237] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0f050d1bbc24370918a812ae15a0d74" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34303 } }
I20260808 17:54:14.706589 29526 external_mini_cluster.cc:1428] Setting key f229d81955ac8bc8d6e2b137f9f73157
I20260808 17:54:14.706719 28388 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e0f050d1bbc24370918a812ae15a0d74. Latest consensus state: current_term: 1 leader_uuid: "e0f050d1bbc24370918a812ae15a0d74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0f050d1bbc24370918a812ae15a0d74" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34303 } } }
I20260808 17:54:14.706787 28388 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:14.706935 28390 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e0f050d1bbc24370918a812ae15a0d74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0f050d1bbc24370918a812ae15a0d74" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34303 } } }
I20260808 17:54:14.706986 28390 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:14.707100 28399 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:14.707877 28399 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:14.709388 28399 catalog_manager.cc:1347] Generated new cluster ID: 21362c285dd944ca8c8c71b71bd0f93e
I20260808 17:54:14.709437 28399 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:54:14 dist-test-slave-bndk krb5kdc[28238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 17:54:14.719141 28405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:14.707236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57187 (local address 127.0.0.1:34303)
0808 17:54:14.707418 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:14.707428 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:14.708810 (+ 1382us) server_negotiation.cc:407] Connection header received
0808 17:54:14.708991 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:14.708999 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:14.709054 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:14.709186 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:14.710010 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:14.711390 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:14.712444 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:14.713040 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:14.713126 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:14.715744 (+ 2618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:14.715749 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:14.715749 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:14.715761 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:14.717645 (+ 1884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:14.718003 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:14.718006 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:14.718007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:14.718110 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:14.718281 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:14.718282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:14.718282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:14.718575 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:14.718726 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:14.718793 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 17:54:14.718923 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":85,"threads_started":1}
I20260808 17:54:14.720009 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:14.722164 28399 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:14.722790 28399 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:14.727720 28399 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e0f050d1bbc24370918a812ae15a0d74: Generated new TSK 0
I20260808 17:54:14.728014 28399 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:14.728190 28405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:14.721510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50395 (local address 127.0.0.1:34303)
0808 17:54:14.721546 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:14.721547 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:14.721572 (+ 25us) server_negotiation.cc:407] Connection header received
0808 17:54:14.721632 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:14.721632 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:14.721640 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:14.721690 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:14.722289 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:14.723001 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:14.723955 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:14.724251 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:14.724299 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:14.725531 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:14.725533 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:14.725533 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:14.725540 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:14.726950 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:14.727307 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:14.727308 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:14.727308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:14.727362 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:14.727570 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:14.727571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:14.727571 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:14.727728 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:14.727815 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:14.727943 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 17:54:14.728028 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:54:14.729907 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 28256
2026-08-08T17:54:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1374 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:14 dist-test-slave-bndk krb5kdc[28432](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:14 dist-test-slave-bndk krb5kdc[28432](info): set up 2 sockets
Aug 08 17:54:14 dist-test-slave-bndk krb5kdc[28432](info): commencing operation
krb5kdc: starting...
W20260808 17:54:15.857117 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:15 dist-test-slave-bndk krb5kdc[28432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211655, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:54:15.963657 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38077
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38077
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:16.041466 28457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:16.041651 28457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:16.041680 28457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:16.042758 28457 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:16.042796 28457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:16.042815 28457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:16.042830 28457 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:16.042847 28457 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:16.044262 28457 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38077
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:16.044487 28457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:16.044684 28457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:16.049103 28475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:16.049130 28472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:16.049108 28473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:16.049270 28457 server_base.cc:1034] running on GCE node
I20260808 17:54:16.049530 28457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:16.049767 28457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:16.050899 28457 hybrid_clock.cc:648] HybridClock initialized: now 1786211656050883 us; error 32 us; skew 500 ppm
Aug 08 17:54:16 dist-test-slave-bndk krb5kdc[28432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211656, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:16.055948 28457 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:54:16.056355 28457 webserver.cc:460] Webserver started at http://127.0.0.1:42633/ using document root <none> and password file <none>
I20260808 17:54:16.056577 28457 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:16.056627 28457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:16.056747 28457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:16.057777 28457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "769a0f4ad62a4bca8b1e54f3bd9a1be4"
format_stamp: "Formatted at 2026-08-08 17:54:16 on dist-test-slave-bndk"
server_key: "2a5747ef6646afad9a70ff22fef1b376"
server_key_iv: "0319886161b48e48d142bb8cbcd88372"
server_key_version: "encryptionkey@0"
I20260808 17:54:16.058097 28457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "769a0f4ad62a4bca8b1e54f3bd9a1be4"
format_stamp: "Formatted at 2026-08-08 17:54:16 on dist-test-slave-bndk"
server_key: "2a5747ef6646afad9a70ff22fef1b376"
server_key_iv: "0319886161b48e48d142bb8cbcd88372"
server_key_version: "encryptionkey@0"
I20260808 17:54:16.059360 28457 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 17:54:16.059976 28484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:16.060120 28457 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:16.060199 28457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "769a0f4ad62a4bca8b1e54f3bd9a1be4"
format_stamp: "Formatted at 2026-08-08 17:54:16 on dist-test-slave-bndk"
server_key: "2a5747ef6646afad9a70ff22fef1b376"
server_key_iv: "0319886161b48e48d142bb8cbcd88372"
server_key_version: "encryptionkey@0"
I20260808 17:54:16.060256 28457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:16.086946 28457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:16.088482 28457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:16.088604 28457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:16.092253 28457 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38077
I20260808 17:54:16.092285 28563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38077 every 8 connection(s)
I20260808 17:54:16.092571 28457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:16.093360 28565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:16.095398 28565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4: Bootstrap starting.
I20260808 17:54:16.095939 28565 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:16.096186 28565 log.cc:824] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:16.096786 28565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4: No bootstrap required, opened a new log
I20260808 17:54:16.097468 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 28457
I20260808 17:54:16.097575 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:16.097746 29526 external_mini_cluster.cc:1428] Setting key 007d6dc54c6c8587b05ad508d4db995c
I20260808 17:54:16.098673 28565 raft_consensus.cc:348] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "769a0f4ad62a4bca8b1e54f3bd9a1be4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38077 } }
I20260808 17:54:16.098834 28565 raft_consensus.cc:374] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:16.098912 28565 raft_consensus.cc:729] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 769a0f4ad62a4bca8b1e54f3bd9a1be4, State: Initialized, Role: FOLLOWER
I20260808 17:54:16.099040 28565 consensus_queue.cc:260] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "769a0f4ad62a4bca8b1e54f3bd9a1be4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38077 } }
I20260808 17:54:16.099125 28565 raft_consensus.cc:388] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:16.099161 28565 raft_consensus.cc:482] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:16.099210 28565 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:16.099855 28565 raft_consensus.cc:504] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "769a0f4ad62a4bca8b1e54f3bd9a1be4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38077 } }
I20260808 17:54:16.099961 28565 leader_election.cc:302] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 769a0f4ad62a4bca8b1e54f3bd9a1be4; no voters:
I20260808 17:54:16.100103 28565 leader_election.cc:288] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:16.100138 28571 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:16.100268 28571 raft_consensus.cc:686] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4 [term 1 LEADER]: Becoming Leader. State: Replica: 769a0f4ad62a4bca8b1e54f3bd9a1be4, State: Running, Role: LEADER
I20260808 17:54:16.100319 28565 sys_catalog.cc:564] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:16.100402 28571 consensus_queue.cc:237] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "769a0f4ad62a4bca8b1e54f3bd9a1be4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38077 } }
I20260808 17:54:16.100726 28571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 769a0f4ad62a4bca8b1e54f3bd9a1be4. Latest consensus state: current_term: 1 leader_uuid: "769a0f4ad62a4bca8b1e54f3bd9a1be4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "769a0f4ad62a4bca8b1e54f3bd9a1be4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38077 } } }
I20260808 17:54:16.100896 28571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:16.100835 28574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "769a0f4ad62a4bca8b1e54f3bd9a1be4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "769a0f4ad62a4bca8b1e54f3bd9a1be4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38077 } } }
I20260808 17:54:16.101083 28574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:16.101595 28587 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:16.102115 28587 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:16.103762 28570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:16.098200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47845 (local address 127.0.0.1:38077)
0808 17:54:16.098397 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:16.098407 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:16.098441 (+ 34us) server_negotiation.cc:407] Connection header received
0808 17:54:16.098632 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:16.098639 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:16.098694 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:16.098832 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:16.099014 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:16.100560 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:16.101591 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:16.102199 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:16.102302 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:16.103108 (+ 806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:16.103111 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:16.103112 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:16.103315 (+ 203us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:16.103353 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:16.103380 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:16.103445 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:16.103534 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 17:54:16.103592 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":91,"threads_started":1}
I20260808 17:54:16.104008 28587 catalog_manager.cc:1347] Generated new cluster ID: c9aa740593184db9875711bdfe9e32cb
I20260808 17:54:16.104043 28587 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:16.104552 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:16.109017 28570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:16.105996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52651 (local address 127.0.0.1:38077)
0808 17:54:16.106027 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:16.106029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:16.106099 (+ 70us) server_negotiation.cc:407] Connection header received
0808 17:54:16.106158 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:16.106159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:16.106168 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:16.106215 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:16.106326 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:16.107010 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:16.107901 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:16.108190 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:16.108258 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:16.108799 (+ 541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:16.108801 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:16.108801 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:16.108805 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:16.108819 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:16.108823 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:16.108879 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:16.108926 (+ 47us) server_negotiation.cc:299] Negotiation successful
0808 17:54:16.108948 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:54:16.116786 28587 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:16.117478 28587 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:16.124150 28587 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 769a0f4ad62a4bca8b1e54f3bd9a1be4: Generated new TSK 0
I20260808 17:54:16.124301 28587 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:16.126138 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 28457
2026-08-08T17:54:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1399 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:16 dist-test-slave-bndk krb5kdc[28617](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:16 dist-test-slave-bndk krb5kdc[28617](info): set up 2 sockets
Aug 08 17:54:16 dist-test-slave-bndk krb5kdc[28617](info): commencing operation
krb5kdc: starting...
W20260808 17:54:17.257922 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:17 dist-test-slave-bndk krb5kdc[28617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211657, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:54:17.367182 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45359
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45359
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:17.445392 28638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:17.445580 28638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:17.445600 28638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:17.446647 28638 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:17.446679 28638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:17.446692 28638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:17.446703 28638 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:17.446717 28638 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:17.448074 28638 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45359
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:17.448246 28638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:17.448402 28638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:17.452750 28653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:17.452761 28649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:17.452734 28650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:17.452919 28638 server_base.cc:1034] running on GCE node
I20260808 17:54:17.453187 28638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:17.453467 28638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:17.454604 28638 hybrid_clock.cc:648] HybridClock initialized: now 1786211657454589 us; error 26 us; skew 500 ppm
Aug 08 17:54:17 dist-test-slave-bndk krb5kdc[28617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211657, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:17.456948 28638 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:54:17.457360 28638 webserver.cc:460] Webserver started at http://127.0.0.1:34623/ using document root <none> and password file <none>
I20260808 17:54:17.457553 28638 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:17.457598 28638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:17.457720 28638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:17.458666 28638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "3a79c8826e7d49eb9a52b6c031df2635"
format_stamp: "Formatted at 2026-08-08 17:54:17 on dist-test-slave-bndk"
server_key: "698509832fecda7c0b87fe02ac311325"
server_key_iv: "ec076e92f681904ae0418b68f4e65a09"
server_key_version: "encryptionkey@0"
I20260808 17:54:17.459059 28638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "3a79c8826e7d49eb9a52b6c031df2635"
format_stamp: "Formatted at 2026-08-08 17:54:17 on dist-test-slave-bndk"
server_key: "698509832fecda7c0b87fe02ac311325"
server_key_iv: "ec076e92f681904ae0418b68f4e65a09"
server_key_version: "encryptionkey@0"
I20260808 17:54:17.460305 28638 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:54:17.460961 28660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:17.461105 28638 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:54:17.461185 28638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "3a79c8826e7d49eb9a52b6c031df2635"
format_stamp: "Formatted at 2026-08-08 17:54:17 on dist-test-slave-bndk"
server_key: "698509832fecda7c0b87fe02ac311325"
server_key_iv: "ec076e92f681904ae0418b68f4e65a09"
server_key_version: "encryptionkey@0"
I20260808 17:54:17.461277 28638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:17.464265 28638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:17.465899 28638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:17.466014 28638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:17.469683 28638 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45359
I20260808 17:54:17.469712 28739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45359 every 8 connection(s)
I20260808 17:54:17.470000 28638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:17.470858 28740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:17.470966 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 28638
I20260808 17:54:17.471072 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:17.471231 29526 external_mini_cluster.cc:1428] Setting key 43af23a905c6f05621add428861b390f
I20260808 17:54:17.473176 28740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635: Bootstrap starting.
I20260808 17:54:17.473426 28744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:17.471675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41243 (local address 127.0.0.1:45359)
0808 17:54:17.471865 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:17.471873 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:17.471895 (+ 22us) server_negotiation.cc:407] Connection header received
0808 17:54:17.472270 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:17.472276 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:17.472299 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:17.472428 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:17.473025 (+ 597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:17.473028 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:17.473029 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:17.473032 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:17.473069 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:17.473078 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:17.473131 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:17.473192 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 17:54:17.473285 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":76,"threads_started":1}
I20260808 17:54:17.473840 28740 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:17.474133 28740 log.cc:824] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:17.474323 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:17.474769 28740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635: No bootstrap required, opened a new log
I20260808 17:54:17.476543 28744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:17.475613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56973 (local address 127.0.0.1:45359)
0808 17:54:17.475651 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:17.475653 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:17.475761 (+ 108us) server_negotiation.cc:407] Connection header received
0808 17:54:17.475817 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:17.475818 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:17.475823 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:17.475879 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:17.476349 (+ 470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:17.476350 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:17.476350 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:17.476354 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:17.476379 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:17.476383 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:17.476428 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:17.476476 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 17:54:17.476487 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 17:54:17.476816 28740 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a79c8826e7d49eb9a52b6c031df2635" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45359 } }
I20260808 17:54:17.476982 28740 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:17.477029 28740 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a79c8826e7d49eb9a52b6c031df2635, State: Initialized, Role: FOLLOWER
I20260808 17:54:17.477139 28740 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a79c8826e7d49eb9a52b6c031df2635" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45359 } }
I20260808 17:54:17.477209 28740 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:17.477298 28740 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:17.477346 28740 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:17.477830 28740 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a79c8826e7d49eb9a52b6c031df2635" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45359 } }
I20260808 17:54:17.477928 28740 leader_election.cc:302] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a79c8826e7d49eb9a52b6c031df2635; no voters:
I20260808 17:54:17.478078 28740 leader_election.cc:288] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:17.478123 28754 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:17.478269 28754 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635 [term 1 LEADER]: Becoming Leader. State: Replica: 3a79c8826e7d49eb9a52b6c031df2635, State: Running, Role: LEADER
I20260808 17:54:17.478286 28740 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:17.478358 28754 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a79c8826e7d49eb9a52b6c031df2635" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45359 } }
I20260808 17:54:17.478698 28756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a79c8826e7d49eb9a52b6c031df2635. Latest consensus state: current_term: 1 leader_uuid: "3a79c8826e7d49eb9a52b6c031df2635" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a79c8826e7d49eb9a52b6c031df2635" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45359 } } }
I20260808 17:54:17.478695 28755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a79c8826e7d49eb9a52b6c031df2635" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a79c8826e7d49eb9a52b6c031df2635" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45359 } } }
I20260808 17:54:17.478807 28756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:17.478813 28755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635 [sys.catalog]: This master's current role is: LEADER
W20260808 17:54:17.479974 28780 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:54:17.480028 28780 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:54:17.480096 28769 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:17.480278 28769 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:17.481640 28769 catalog_manager.cc:1347] Generated new cluster ID: 8786aea739a74f01bc2eeeeeb9949c0a
I20260808 17:54:17.481683 28769 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:17.492537 28769 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:17.492681 28769 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:17.495132 28769 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a79c8826e7d49eb9a52b6c031df2635: Generated new TSK 0
I20260808 17:54:17.495285 28769 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:17.498464 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 28638
2026-08-08T17:54:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1369 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:17 dist-test-slave-bndk krb5kdc[28788](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:17 dist-test-slave-bndk krb5kdc[28788](info): set up 2 sockets
Aug 08 17:54:17 dist-test-slave-bndk krb5kdc[28788](info): commencing operation
krb5kdc: starting...
W20260808 17:54:18.628777 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:18 dist-test-slave-bndk krb5kdc[28788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211658, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:54:18.737699 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46205
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46205
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:18.815763 28814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:18.815949 28814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:18.815979 28814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:18.817075 28814 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:18.817114 28814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:18.817133 28814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:18.817149 28814 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:18.817164 28814 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:18.818625 28814 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46205
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:18.818864 28814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:18.819061 28814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:18.823570 28820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:18.823588 28821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:18.823647 28814 server_base.cc:1034] running on GCE node
W20260808 17:54:18.823612 28826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:18.823978 28814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:18.824234 28814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:18.825377 28814 hybrid_clock.cc:648] HybridClock initialized: now 1786211658825364 us; error 28 us; skew 500 ppm
Aug 08 17:54:18 dist-test-slave-bndk krb5kdc[28788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211658, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:18.827593 28814 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:54:18.827988 28814 webserver.cc:460] Webserver started at http://127.0.0.1:37489/ using document root <none> and password file <none>
I20260808 17:54:18.828163 28814 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:18.828200 28814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:18.828289 28814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:18.829201 28814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "cd221409968b4705822d6fa9313fa12c"
format_stamp: "Formatted at 2026-08-08 17:54:18 on dist-test-slave-bndk"
server_key: "b6165760fba20c46fb63d5f6e2e94ca2"
server_key_iv: "a0f8af62289e2dc492071b5d3cb54ec5"
server_key_version: "encryptionkey@0"
I20260808 17:54:18.829521 28814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "cd221409968b4705822d6fa9313fa12c"
format_stamp: "Formatted at 2026-08-08 17:54:18 on dist-test-slave-bndk"
server_key: "b6165760fba20c46fb63d5f6e2e94ca2"
server_key_iv: "a0f8af62289e2dc492071b5d3cb54ec5"
server_key_version: "encryptionkey@0"
I20260808 17:54:18.830757 28814 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:54:18.831420 28837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:18.831558 28814 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:54:18.831636 28814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "cd221409968b4705822d6fa9313fa12c"
format_stamp: "Formatted at 2026-08-08 17:54:18 on dist-test-slave-bndk"
server_key: "b6165760fba20c46fb63d5f6e2e94ca2"
server_key_iv: "a0f8af62289e2dc492071b5d3cb54ec5"
server_key_version: "encryptionkey@0"
I20260808 17:54:18.831697 28814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:18.874907 28814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:18.876785 28814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:18.876921 28814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:18.880690 28814 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46205
I20260808 17:54:18.880734 28923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46205 every 8 connection(s)
I20260808 17:54:18.881047 28814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:18.881780 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 28814
I20260808 17:54:18.881893 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:18.881922 28924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:18.882092 29526 external_mini_cluster.cc:1428] Setting key 9c3c7d4ad188266cd149ffdcc8c36688
I20260808 17:54:18.885126 28924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c: Bootstrap starting.
I20260808 17:54:18.885834 28924 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:18.886112 28924 log.cc:824] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:18.886814 28924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c: No bootstrap required, opened a new log
Aug 08 17:54:18 dist-test-slave-bndk krb5kdc[28788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211658, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 17:54:18.888617 28924 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd221409968b4705822d6fa9313fa12c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46205 } }
I20260808 17:54:18.888752 28924 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:18.888785 28924 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd221409968b4705822d6fa9313fa12c, State: Initialized, Role: FOLLOWER
I20260808 17:54:18.888909 28924 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd221409968b4705822d6fa9313fa12c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46205 } }
I20260808 17:54:18.888995 28924 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:18.889027 28924 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:18.889086 28924 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:18.889751 28924 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd221409968b4705822d6fa9313fa12c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46205 } }
I20260808 17:54:18.889861 28924 leader_election.cc:302] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd221409968b4705822d6fa9313fa12c; no voters:
I20260808 17:54:18.890033 28924 leader_election.cc:288] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:18.890081 28932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:18.890229 28932 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c [term 1 LEADER]: Becoming Leader. State: Replica: cd221409968b4705822d6fa9313fa12c, State: Running, Role: LEADER
I20260808 17:54:18.890297 28924 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:18.890326 28932 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd221409968b4705822d6fa9313fa12c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46205 } }
I20260808 17:54:18.890651 28932 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd221409968b4705822d6fa9313fa12c. Latest consensus state: current_term: 1 leader_uuid: "cd221409968b4705822d6fa9313fa12c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd221409968b4705822d6fa9313fa12c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46205 } } }
I20260808 17:54:18.890738 28932 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:18.890662 28936 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd221409968b4705822d6fa9313fa12c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd221409968b4705822d6fa9313fa12c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46205 } } }
I20260808 17:54:18.890813 28936 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:18.891572 28940 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:18.892066 28940 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:18.892599 28928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:18.882557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:50199 (local address 127.0.0.1:46205)
0808 17:54:18.882748 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:18.882759 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:18.882802 (+ 43us) server_negotiation.cc:407] Connection header received
0808 17:54:18.883394 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:18.883405 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:18.883473 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:18.883627 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:18.884182 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:18.885515 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:18.886272 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:18.886797 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:18.886918 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:18.888957 (+ 2039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:18.888962 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:18.888962 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:18.888973 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:18.890741 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:18.891178 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:18.891180 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:18.891181 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:18.891265 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:18.891640 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:18.891642 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:18.891642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:18.891966 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:18.892111 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:18.892284 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 17:54:18.892401 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":81,"threads_started":1}
I20260808 17:54:18.893638 28940 catalog_manager.cc:1347] Generated new cluster ID: 59ed9ddb67544debb75c62905d809a57
I20260808 17:54:18.893687 28940 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:18.893678 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:18.898815 28940 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:18.899492 28940 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:18.901916 28928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:18.895051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:40423 (local address 127.0.0.1:46205)
0808 17:54:18.895084 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:18.895085 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:18.895183 (+ 98us) server_negotiation.cc:407] Connection header received
0808 17:54:18.895258 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:18.895258 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:18.895266 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:18.895297 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:18.895889 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:18.896600 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:18.897581 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:18.897894 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:18.897930 (+ 36us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:18.899251 (+ 1321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:18.899252 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:18.899252 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:18.899258 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:18.900772 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:18.901146 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:18.901146 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:18.901147 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:18.901192 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:18.901421 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:18.901422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:18.901422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:18.901525 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:18.901587 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:18.901777 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 17:54:18.901836 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13}
I20260808 17:54:18.905012 28940 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd221409968b4705822d6fa9313fa12c: Generated new TSK 0
I20260808 17:54:18.905167 28940 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:18.909153 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 28814
W20260808 17:54:18.923421 28785 connection.cc:535] client connection to 127.0.0.1:46205 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46205): Connection reset by peer (error 104)
2026-08-08T17:54:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1410 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:18 dist-test-slave-bndk krb5kdc[28969](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:18 dist-test-slave-bndk krb5kdc[28969](info): set up 2 sockets
Aug 08 17:54:18 dist-test-slave-bndk krb5kdc[28969](info): commencing operation
krb5kdc: starting...
W20260808 17:54:20.029814 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:20 dist-test-slave-bndk krb5kdc[28969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211660, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:54:20.140787 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35719
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35719
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:20.220252 28996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:20.220451 28996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:20.220474 28996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:20.221558 28996 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:20.221593 28996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:20.221606 28996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:20.221616 28996 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:20.221629 28996 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:20.222988 28996 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35719
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28996
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:20.223166 28996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:20.223335 28996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:20.227717 29008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:20.227727 29002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:20.227789 29005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:20.228000 28996 server_base.cc:1034] running on GCE node
I20260808 17:54:20.228184 28996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:20.228412 28996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:20.229544 28996 hybrid_clock.cc:648] HybridClock initialized: now 1786211660229528 us; error 29 us; skew 500 ppm
Aug 08 17:54:20 dist-test-slave-bndk krb5kdc[28969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211660, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:20.231882 28996 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:54:20.232257 28996 webserver.cc:460] Webserver started at http://127.0.0.1:33411/ using document root <none> and password file <none>
I20260808 17:54:20.232438 28996 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:20.232481 28996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:20.232596 28996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:20.233588 28996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "83dc86e1ddd9476d9f72c82d71ce4e98"
format_stamp: "Formatted at 2026-08-08 17:54:20 on dist-test-slave-bndk"
server_key: "1c64cf7a67666115b763be4943cf7f9c"
server_key_iv: "b69c1bc87a971fa018ac724c2413f38b"
server_key_version: "encryptionkey@0"
I20260808 17:54:20.233898 28996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "83dc86e1ddd9476d9f72c82d71ce4e98"
format_stamp: "Formatted at 2026-08-08 17:54:20 on dist-test-slave-bndk"
server_key: "1c64cf7a67666115b763be4943cf7f9c"
server_key_iv: "b69c1bc87a971fa018ac724c2413f38b"
server_key_version: "encryptionkey@0"
I20260808 17:54:20.235093 28996 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:54:20.235764 29021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:20.235894 28996 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:20.235982 28996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "83dc86e1ddd9476d9f72c82d71ce4e98"
format_stamp: "Formatted at 2026-08-08 17:54:20 on dist-test-slave-bndk"
server_key: "1c64cf7a67666115b763be4943cf7f9c"
server_key_iv: "b69c1bc87a971fa018ac724c2413f38b"
server_key_version: "encryptionkey@0"
I20260808 17:54:20.236042 28996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:20.251477 28996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:20.253072 28996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:20.253197 28996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:20.256974 28996 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35719
I20260808 17:54:20.257014 29094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35719 every 8 connection(s)
I20260808 17:54:20.257359 28996 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:20.258175 29095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:20.260298 29095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98: Bootstrap starting.
I20260808 17:54:20.260963 29095 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:20.261243 29095 log.cc:824] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:20.261915 29095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98: No bootstrap required, opened a new log
I20260808 17:54:20.263439 29095 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dc86e1ddd9476d9f72c82d71ce4e98" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35719 } }
I20260808 17:54:20.263569 29095 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:20.263592 29095 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83dc86e1ddd9476d9f72c82d71ce4e98, State: Initialized, Role: FOLLOWER
I20260808 17:54:20.263724 29095 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dc86e1ddd9476d9f72c82d71ce4e98" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35719 } }
I20260808 17:54:20.263783 29095 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:20.263804 29095 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:20.263847 29095 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:20.264336 29095 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dc86e1ddd9476d9f72c82d71ce4e98" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35719 } }
I20260808 17:54:20.264424 29095 leader_election.cc:302] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83dc86e1ddd9476d9f72c82d71ce4e98; no voters:
I20260808 17:54:20.264586 29095 leader_election.cc:288] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:20.264627 29099 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:20.264694 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 28996
I20260808 17:54:20.264740 29099 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98 [term 1 LEADER]: Becoming Leader. State: Replica: 83dc86e1ddd9476d9f72c82d71ce4e98, State: Running, Role: LEADER
I20260808 17:54:20.264811 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:20.264837 29095 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:20.264820 29099 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dc86e1ddd9476d9f72c82d71ce4e98" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35719 } }
I20260808 17:54:20.264993 29526 external_mini_cluster.cc:1428] Setting key 364ee5504d4c4b3f9d49946369e555b6
I20260808 17:54:20.265394 29102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83dc86e1ddd9476d9f72c82d71ce4e98. Latest consensus state: current_term: 1 leader_uuid: "83dc86e1ddd9476d9f72c82d71ce4e98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dc86e1ddd9476d9f72c82d71ce4e98" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35719 } } }
I20260808 17:54:20.265558 29102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:20.265758 29101 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83dc86e1ddd9476d9f72c82d71ce4e98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dc86e1ddd9476d9f72c82d71ce4e98" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35719 } } }
I20260808 17:54:20.265870 29101 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:20.265995 29110 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:20.266547 29110 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:20.268127 29110 catalog_manager.cc:1347] Generated new cluster ID: 8d30708c3eda41c083eefb391310e90c
I20260808 17:54:20.268180 29110 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:20.270226 29108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:20.265383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:54979 (local address 127.0.0.1:35719)
0808 17:54:20.265776 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:20.265786 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:20.265818 (+ 32us) server_negotiation.cc:407] Connection header received
0808 17:54:20.265943 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:20.265950 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:20.266009 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:20.266145 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:20.266377 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:20.267667 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:20.268519 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:20.268929 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:20.269022 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:20.269648 (+ 626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:20.269652 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:20.269653 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:20.269822 (+ 169us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:20.269851 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:20.269861 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:20.269942 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:20.270024 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 17:54:20.270050 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":72,"threads_started":1}
I20260808 17:54:20.274115 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:20.280158 29108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:20.277499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:51345 (local address 127.0.0.1:35719)
0808 17:54:20.277533 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:20.277535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:20.277659 (+ 124us) server_negotiation.cc:407] Connection header received
0808 17:54:20.277712 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:20.277713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:20.277724 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:20.277768 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:20.277880 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:20.278378 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:20.279075 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:20.279308 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:20.279363 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:20.279940 (+ 577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:20.279941 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:20.279942 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:20.279946 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:20.279962 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:20.279966 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:20.280010 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:20.280077 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 17:54:20.280087 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":9,"server-negotiator.queue_time_us":18}
I20260808 17:54:20.294616 29110 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:20.295235 29110 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:20.300709 29110 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83dc86e1ddd9476d9f72c82d71ce4e98: Generated new TSK 0
I20260808 17:54:20.300861 29110 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:20.303789 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 28996
W20260808 17:54:20.316533 28966 connection.cc:535] client connection to 127.0.0.1:35719 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35719): Connection reset by peer (error 104)
2026-08-08T17:54:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1393 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:20 dist-test-slave-bndk krb5kdc[29145](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:20 dist-test-slave-bndk krb5kdc[29145](info): set up 2 sockets
Aug 08 17:54:20 dist-test-slave-bndk krb5kdc[29145](info): commencing operation
krb5kdc: starting...
W20260808 17:54:21.426318 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:21 dist-test-slave-bndk krb5kdc[29145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211661, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:54:21.535384 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33375
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33375
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:21.613245 29168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:21.613452 29168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:21.613481 29168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:21.614588 29168 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:21.614626 29168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:21.614645 29168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:21.614660 29168 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:21.614676 29168 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:21.616124 29168 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33375
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29168
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:21.616350 29168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:21.616567 29168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:21.620971 29176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:21.621158 29183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:21.621109 29168 server_base.cc:1034] running on GCE node
W20260808 17:54:21.620970 29174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:21.621560 29168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:21.621824 29168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:21.622965 29168 hybrid_clock.cc:648] HybridClock initialized: now 1786211661622952 us; error 30 us; skew 500 ppm
Aug 08 17:54:21 dist-test-slave-bndk krb5kdc[29145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211661, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:21.628180 29168 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:54:21.628592 29168 webserver.cc:460] Webserver started at http://127.0.0.1:43395/ using document root <none> and password file <none>
I20260808 17:54:21.628786 29168 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:21.628835 29168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:21.628968 29168 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:21.630015 29168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "3ee1701be6a740a9ae8bb88bd6085e3e"
format_stamp: "Formatted at 2026-08-08 17:54:21 on dist-test-slave-bndk"
server_key: "1d317e20735425e3ed216d45859f768c"
server_key_iv: "98fa362221e545114766d8729206f216"
server_key_version: "encryptionkey@0"
I20260808 17:54:21.630330 29168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "3ee1701be6a740a9ae8bb88bd6085e3e"
format_stamp: "Formatted at 2026-08-08 17:54:21 on dist-test-slave-bndk"
server_key: "1d317e20735425e3ed216d45859f768c"
server_key_iv: "98fa362221e545114766d8729206f216"
server_key_version: "encryptionkey@0"
I20260808 17:54:21.631588 29168 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:54:21.632287 29192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:21.632439 29168 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:54:21.632521 29168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "3ee1701be6a740a9ae8bb88bd6085e3e"
format_stamp: "Formatted at 2026-08-08 17:54:21 on dist-test-slave-bndk"
server_key: "1d317e20735425e3ed216d45859f768c"
server_key_iv: "98fa362221e545114766d8729206f216"
server_key_version: "encryptionkey@0"
I20260808 17:54:21.632580 29168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:21.635668 29168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:21.637630 29168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:21.637750 29168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:21.641494 29168 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33375
I20260808 17:54:21.641542 29260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33375 every 8 connection(s)
I20260808 17:54:21.641810 29168 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:21.642944 29261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:21.646102 29261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e: Bootstrap starting.
I20260808 17:54:21.646785 29261 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:21.647143 29261 log.cc:824] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:21.647905 29261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e: No bootstrap required, opened a new log
I20260808 17:54:21.649329 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 29168
I20260808 17:54:21.649439 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:21.649607 29526 external_mini_cluster.cc:1428] Setting key 371b540a597e0fc9c70b476fafb55ca6
I20260808 17:54:21.650256 29261 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ee1701be6a740a9ae8bb88bd6085e3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33375 } }
I20260808 17:54:21.650441 29261 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:21.650549 29261 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ee1701be6a740a9ae8bb88bd6085e3e, State: Initialized, Role: FOLLOWER
I20260808 17:54:21.651057 29261 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ee1701be6a740a9ae8bb88bd6085e3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33375 } }
I20260808 17:54:21.651180 29261 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:21.651255 29261 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:21.651331 29261 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:21.651657 29266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:21.650031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:56871 (local address 127.0.0.1:33375)
0808 17:54:21.650211 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:21.650218 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:21.650243 (+ 25us) server_negotiation.cc:407] Connection header received
0808 17:54:21.650330 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:21.650335 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:21.650355 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:21.650490 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:21.651138 (+ 648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:21.651141 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:21.651141 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:21.651145 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:21.651182 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:21.651197 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:21.651254 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:21.651484 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 17:54:21.651520 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":91,"threads_started":1}
I20260808 17:54:21.652371 29261 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ee1701be6a740a9ae8bb88bd6085e3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33375 } }
I20260808 17:54:21.652501 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:21.652519 29261 leader_election.cc:302] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ee1701be6a740a9ae8bb88bd6085e3e; no voters:
I20260808 17:54:21.652669 29261 leader_election.cc:288] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:21.652704 29267 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:21.652880 29267 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e [term 1 LEADER]: Becoming Leader. State: Replica: 3ee1701be6a740a9ae8bb88bd6085e3e, State: Running, Role: LEADER
I20260808 17:54:21.652967 29261 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:21.653009 29267 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ee1701be6a740a9ae8bb88bd6085e3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33375 } }
I20260808 17:54:21.653422 29267 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ee1701be6a740a9ae8bb88bd6085e3e. Latest consensus state: current_term: 1 leader_uuid: "3ee1701be6a740a9ae8bb88bd6085e3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ee1701be6a740a9ae8bb88bd6085e3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33375 } } }
I20260808 17:54:21.653640 29267 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:21.653573 29268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ee1701be6a740a9ae8bb88bd6085e3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ee1701be6a740a9ae8bb88bd6085e3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33375 } } }
I20260808 17:54:21.654026 29268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e [sys.catalog]: This master's current role is: LEADER
W20260808 17:54:21.654836 29306 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:54:21.654889 29306 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:54:21.654942 29291 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:21.655128 29291 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:21.655319 29266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:21.654120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:36487 (local address 127.0.0.1:33375)
0808 17:54:21.654157 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:21.654159 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:21.654387 (+ 228us) server_negotiation.cc:407] Connection header received
0808 17:54:21.654509 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:21.654510 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:21.654516 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:21.654576 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:21.655105 (+ 529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:21.655106 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:21.655106 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:21.655111 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:21.655125 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:21.655129 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:21.655190 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:21.655249 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 17:54:21.655261 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:54:21.656841 29291 catalog_manager.cc:1347] Generated new cluster ID: efbe79b18de34294a3bd7fc2c2c7002b
I20260808 17:54:21.656896 29291 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:21.675020 29291 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:21.675211 29291 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:21.682431 29291 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ee1701be6a740a9ae8bb88bd6085e3e: Generated new TSK 0
I20260808 17:54:21.682585 29291 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:21.692449 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 29168
2026-08-08T17:54:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1389 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:21 dist-test-slave-bndk krb5kdc[29315](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:21 dist-test-slave-bndk krb5kdc[29315](info): set up 2 sockets
Aug 08 17:54:21 dist-test-slave-bndk krb5kdc[29315](info): commencing operation
krb5kdc: starting...
W20260808 17:54:22.821051 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:22 dist-test-slave-bndk krb5kdc[29315](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211662, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:54:22.929764 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37465
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37465
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:23.009117 29334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:23.009354 29334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:23.009390 29334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:23.010495 29334 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:23.010535 29334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:23.010553 29334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:23.010568 29334 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:23.010584 29334 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:23.012033 29334 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37465
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:23.012270 29334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:23.012482 29334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:23.016866 29347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:23.016965 29334 server_base.cc:1034] running on GCE node
W20260808 17:54:23.016858 29344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:23.016880 29345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:23.017292 29334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:23.017534 29334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:23.018671 29334 hybrid_clock.cc:648] HybridClock initialized: now 1786211663018659 us; error 29 us; skew 500 ppm
Aug 08 17:54:23 dist-test-slave-bndk krb5kdc[29315](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211663, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:23.020916 29334 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:54:23.021334 29334 webserver.cc:460] Webserver started at http://127.0.0.1:32775/ using document root <none> and password file <none>
I20260808 17:54:23.021559 29334 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:23.021605 29334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:23.021728 29334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:23.022678 29334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "1f6f23b9149c43e4b6c1397ec69aa524"
format_stamp: "Formatted at 2026-08-08 17:54:23 on dist-test-slave-bndk"
server_key: "7964b3916ecf20251da15626f3b2ff3d"
server_key_iv: "dca3834e70e82a42a965ae9ac4a0bbc4"
server_key_version: "encryptionkey@0"
I20260808 17:54:23.022990 29334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "1f6f23b9149c43e4b6c1397ec69aa524"
format_stamp: "Formatted at 2026-08-08 17:54:23 on dist-test-slave-bndk"
server_key: "7964b3916ecf20251da15626f3b2ff3d"
server_key_iv: "dca3834e70e82a42a965ae9ac4a0bbc4"
server_key_version: "encryptionkey@0"
I20260808 17:54:23.024238 29334 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:54:23.024871 29359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:23.025019 29334 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:23.025103 29334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "1f6f23b9149c43e4b6c1397ec69aa524"
format_stamp: "Formatted at 2026-08-08 17:54:23 on dist-test-slave-bndk"
server_key: "7964b3916ecf20251da15626f3b2ff3d"
server_key_iv: "dca3834e70e82a42a965ae9ac4a0bbc4"
server_key_version: "encryptionkey@0"
I20260808 17:54:23.025156 29334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:23.050421 29334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:23.052002 29334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:23.052105 29334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:23.055670 29334 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37465
I20260808 17:54:23.055703 29444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37465 every 8 connection(s)
I20260808 17:54:23.055995 29334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:23.056782 29445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:23.058940 29445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524: Bootstrap starting.
I20260808 17:54:23.059459 29445 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:23.059721 29445 log.cc:824] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:23.060333 29445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524: No bootstrap required, opened a new log
I20260808 17:54:23.061919 29445 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6f23b9149c43e4b6c1397ec69aa524" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37465 } }
I20260808 17:54:23.062047 29445 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:23.062078 29445 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6f23b9149c43e4b6c1397ec69aa524, State: Initialized, Role: FOLLOWER
I20260808 17:54:23.062212 29445 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6f23b9149c43e4b6c1397ec69aa524" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37465 } }
I20260808 17:54:23.062289 29445 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:23.062319 29445 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:23.062363 29445 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:23.062834 29445 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6f23b9149c43e4b6c1397ec69aa524" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37465 } }
I20260808 17:54:23.062934 29445 leader_election.cc:302] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f6f23b9149c43e4b6c1397ec69aa524; no voters:
I20260808 17:54:23.063087 29445 leader_election.cc:288] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:23.063122 29448 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:23.063256 29448 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524 [term 1 LEADER]: Becoming Leader. State: Replica: 1f6f23b9149c43e4b6c1397ec69aa524, State: Running, Role: LEADER
I20260808 17:54:23.063309 29445 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:23.063344 29448 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6f23b9149c43e4b6c1397ec69aa524" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37465 } }
I20260808 17:54:23.063697 29451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f6f23b9149c43e4b6c1397ec69aa524. Latest consensus state: current_term: 1 leader_uuid: "1f6f23b9149c43e4b6c1397ec69aa524" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6f23b9149c43e4b6c1397ec69aa524" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37465 } } }
I20260808 17:54:23.063807 29449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f6f23b9149c43e4b6c1397ec69aa524" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6f23b9149c43e4b6c1397ec69aa524" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37465 } } }
I20260808 17:54:23.063827 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 29334
I20260808 17:54:23.063830 29451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:23.063943 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:23.063910 29449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:23.064148 29526 external_mini_cluster.cc:1428] Setting key 534e99bb44e50a0f378b7c0cd998d517
I20260808 17:54:23.064220 29455 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:23.064728 29455 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:23.066236 29455 catalog_manager.cc:1347] Generated new cluster ID: 4ffa8eb162b546b1a39dd9c833867ad8
I20260808 17:54:23.066283 29455 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:23.074281 29455 catalog_manager.cc:1370] Generated new certificate authority record
Aug 08 17:54:23 dist-test-slave-bndk krb5kdc[29315](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211662, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 17:54:23.074753 29455 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:23.078329 29472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:23.064759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:41325 (local address 127.0.0.1:37465)
0808 17:54:23.064927 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:23.064938 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:23.065408 (+ 470us) server_negotiation.cc:407] Connection header received
0808 17:54:23.065615 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:23.065623 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:23.065678 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:23.065789 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:23.068916 (+ 3127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:23.070374 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:23.071393 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:23.072029 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:23.072143 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:23.074904 (+ 2761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:23.074908 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:23.074909 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:23.074919 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:23.076657 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:23.077086 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:23.077088 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:23.077088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:23.077181 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:23.077411 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:23.077412 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:23.077412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:23.077652 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:23.077795 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:23.077923 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 17:54:23.078116 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":72,"threads_started":1}
I20260808 17:54:23.079139 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:23.087153 29472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:23.080538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:36383 (local address 127.0.0.1:37465)
0808 17:54:23.080579 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:23.080581 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:23.080662 (+ 81us) server_negotiation.cc:407] Connection header received
0808 17:54:23.080705 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:23.080706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:23.080716 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:23.080778 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:23.081337 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:23.082110 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:23.083062 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:23.083379 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:23.083446 (+ 67us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:23.084606 (+ 1160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:23.084607 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:23.084608 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:23.084615 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:23.086079 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:23.086455 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:23.086456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:23.086456 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:23.086512 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:23.086690 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:23.086690 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:23.086690 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:23.086803 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:23.086914 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:23.087008 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 17:54:23.087067 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:54:23.089234 29455 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f6f23b9149c43e4b6c1397ec69aa524: Generated new TSK 0
I20260808 17:54:23.089389 29455 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:23.093400 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 29334
W20260808 17:54:23.104686 29313 connection.cc:535] client connection to 127.0.0.1:37465 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37465): Connection reset by peer (error 104)
2026-08-08T17:54:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1398 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:23 dist-test-slave-bndk krb5kdc[29506](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:23 dist-test-slave-bndk krb5kdc[29506](info): set up 2 sockets
Aug 08 17:54:23 dist-test-slave-bndk krb5kdc[29506](info): commencing operation
krb5kdc: starting...
W20260808 17:54:24.213747 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:24 dist-test-slave-bndk krb5kdc[29506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211664, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:54:24.327858 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43627
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43627
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:24.407228 29532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:24.407425 29532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:24.407456 29532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:24.408546 29532 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:24.408586 29532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:24.408603 29532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:24.408619 29532 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:24.408633 29532 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:24.410109 29532 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43627
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:24.410356 29532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:24.410561 29532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:24.414976 29539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:24.415001 29532 server_base.cc:1034] running on GCE node
W20260808 17:54:24.415005 29540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:24.414978 29542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:24.415400 29532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:24.415632 29532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:24.416761 29532 hybrid_clock.cc:648] HybridClock initialized: now 1786211664416744 us; error 33 us; skew 500 ppm
Aug 08 17:54:24 dist-test-slave-bndk krb5kdc[29506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211664, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:24.419020 29532 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:54:24.419415 29532 webserver.cc:460] Webserver started at http://127.0.0.1:34605/ using document root <none> and password file <none>
I20260808 17:54:24.419608 29532 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:24.419651 29532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:24.419775 29532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:24.420815 29532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "fd0b6423f573482c89c77e370aacaa3f"
format_stamp: "Formatted at 2026-08-08 17:54:24 on dist-test-slave-bndk"
server_key: "7ca945cd8b49e877bf2f731178f21c6d"
server_key_iv: "0d85a335e8c639bb7fd799fa4cd0d769"
server_key_version: "encryptionkey@0"
I20260808 17:54:24.421118 29532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "fd0b6423f573482c89c77e370aacaa3f"
format_stamp: "Formatted at 2026-08-08 17:54:24 on dist-test-slave-bndk"
server_key: "7ca945cd8b49e877bf2f731178f21c6d"
server_key_iv: "0d85a335e8c639bb7fd799fa4cd0d769"
server_key_version: "encryptionkey@0"
I20260808 17:54:24.422338 29532 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:54:24.422959 29553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:24.423108 29532 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:54:24.423188 29532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "fd0b6423f573482c89c77e370aacaa3f"
format_stamp: "Formatted at 2026-08-08 17:54:24 on dist-test-slave-bndk"
server_key: "7ca945cd8b49e877bf2f731178f21c6d"
server_key_iv: "0d85a335e8c639bb7fd799fa4cd0d769"
server_key_version: "encryptionkey@0"
I20260808 17:54:24.423245 29532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:24.438647 29532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:24.440151 29532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:24.440272 29532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:24.443984 29532 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43627
I20260808 17:54:24.444013 29632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43627 every 8 connection(s)
I20260808 17:54:24.444298 29532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:24.445044 29633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:24.447115 29633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f: Bootstrap starting.
I20260808 17:54:24.447630 29633 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:24.447890 29633 log.cc:824] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:24.448486 29633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f: No bootstrap required, opened a new log
I20260808 17:54:24.450026 29633 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd0b6423f573482c89c77e370aacaa3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43627 } }
I20260808 17:54:24.450152 29633 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:24.450183 29633 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd0b6423f573482c89c77e370aacaa3f, State: Initialized, Role: FOLLOWER
I20260808 17:54:24.450309 29633 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd0b6423f573482c89c77e370aacaa3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43627 } }
I20260808 17:54:24.450367 29633 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:24.450390 29633 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:24.450434 29633 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:24.450910 29633 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd0b6423f573482c89c77e370aacaa3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43627 } }
I20260808 17:54:24.450999 29633 leader_election.cc:302] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd0b6423f573482c89c77e370aacaa3f; no voters:
I20260808 17:54:24.451150 29633 leader_election.cc:288] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:24.451181 29637 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:24.451336 29637 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f [term 1 LEADER]: Becoming Leader. State: Replica: fd0b6423f573482c89c77e370aacaa3f, State: Running, Role: LEADER
I20260808 17:54:24.451391 29633 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:24.451424 29637 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd0b6423f573482c89c77e370aacaa3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43627 } }
I20260808 17:54:24.451923 29638 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd0b6423f573482c89c77e370aacaa3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd0b6423f573482c89c77e370aacaa3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43627 } } }
I20260808 17:54:24.452086 29639 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd0b6423f573482c89c77e370aacaa3f. Latest consensus state: current_term: 1 leader_uuid: "fd0b6423f573482c89c77e370aacaa3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd0b6423f573482c89c77e370aacaa3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43627 } } }
I20260808 17:54:24.452211 29639 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:24.452160 29638 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:24.452567 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 29532
I20260808 17:54:24.452677 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:24.452849 29526 external_mini_cluster.cc:1428] Setting key 56836fe7a163c25d9505593b52d83647
I20260808 17:54:24.452975 29649 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:24.453513 29649 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:24.455071 29649 catalog_manager.cc:1347] Generated new cluster ID: fc8dd0a0067a4c78ba8feb3524e044f6
I20260808 17:54:24.455122 29649 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:24.458499 29660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:24.453368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:48633 (local address 127.0.0.1:43627)
0808 17:54:24.454329 (+ 961us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:24.454338 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:24.454367 (+ 29us) server_negotiation.cc:407] Connection header received
0808 17:54:24.454472 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:24.454478 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:24.454541 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:24.454678 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:24.454882 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:24.455839 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:24.456594 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:24.457004 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:24.457103 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:24.457871 (+ 768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:24.457874 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:24.457875 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:24.458033 (+ 158us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:24.458064 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:24.458077 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:24.458152 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:24.458257 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 17:54:24.458286 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":895,"thread_start_us":69,"threads_started":1}
I20260808 17:54:24.459344 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:24.468089 29660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:24.465539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:47017 (local address 127.0.0.1:43627)
0808 17:54:24.465584 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:24.465586 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:24.465681 (+ 95us) server_negotiation.cc:407] Connection header received
0808 17:54:24.465735 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:24.465735 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:24.465747 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:24.465799 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:24.465923 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:24.466369 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:24.467040 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:24.467252 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:24.467305 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:24.467868 (+ 563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:24.467869 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:24.467869 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:24.467873 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:24.467886 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:24.467890 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:24.467943 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:24.468010 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 17:54:24.468021 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 17:54:24.473047 29649 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:24.473731 29649 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:24.478634 29649 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd0b6423f573482c89c77e370aacaa3f: Generated new TSK 0
I20260808 17:54:24.478801 29649 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:24.483438 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 29532
W20260808 17:54:24.498806 29503 connection.cc:535] client connection to 127.0.0.1:43627 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43627): Connection reset by peer (error 104)
2026-08-08T17:54:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1394 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:24 dist-test-slave-bndk krb5kdc[29680](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:24 dist-test-slave-bndk krb5kdc[29680](info): set up 2 sockets
Aug 08 17:54:24 dist-test-slave-bndk krb5kdc[29680](info): commencing operation
krb5kdc: starting...
W20260808 17:54:25.619411 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:25 dist-test-slave-bndk krb5kdc[29680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 17:54:25.732021 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38163
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:25.812508 29694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:25.812691 29694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:25.812721 29694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:25.813831 29694 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:25.813869 29694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:25.813884 29694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:25.813894 29694 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:25.813910 29694 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:25.815260 29694 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38163
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:25.815441 29694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:25.815604 29694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:25.819983 29706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:25.820017 29705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:25.819984 29708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:25.820009 29694 server_base.cc:1034] running on GCE node
I20260808 17:54:25.820384 29694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:25.820653 29694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:25.821786 29694 hybrid_clock.cc:648] HybridClock initialized: now 1786211665821774 us; error 25 us; skew 500 ppm
Aug 08 17:54:25 dist-test-slave-bndk krb5kdc[29680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211665, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:25.823978 29694 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 17:54:25.824354 29694 webserver.cc:460] Webserver started at http://127.0.0.1:46069/ using document root <none> and password file <none>
I20260808 17:54:25.824539 29694 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:25.824585 29694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:25.824708 29694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:25.825732 29694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "f9716202386342528ea6b38c1696f0ba"
format_stamp: "Formatted at 2026-08-08 17:54:25 on dist-test-slave-bndk"
server_key: "865cb684d1e2e4d06f78f1df64a7274e"
server_key_iv: "31897dab7514f149286b777c918dd472"
server_key_version: "encryptionkey@0"
I20260808 17:54:25.826052 29694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "f9716202386342528ea6b38c1696f0ba"
format_stamp: "Formatted at 2026-08-08 17:54:25 on dist-test-slave-bndk"
server_key: "865cb684d1e2e4d06f78f1df64a7274e"
server_key_iv: "31897dab7514f149286b777c918dd472"
server_key_version: "encryptionkey@0"
I20260808 17:54:25.827306 29694 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:54:25.827910 29722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:25.828035 29694 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:25.828116 29694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "f9716202386342528ea6b38c1696f0ba"
format_stamp: "Formatted at 2026-08-08 17:54:25 on dist-test-slave-bndk"
server_key: "865cb684d1e2e4d06f78f1df64a7274e"
server_key_iv: "31897dab7514f149286b777c918dd472"
server_key_version: "encryptionkey@0"
I20260808 17:54:25.828172 29694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:25.831244 29694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:25.832878 29694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:25.833009 29694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:25.836599 29694 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38163
I20260808 17:54:25.836642 29805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38163 every 8 connection(s)
I20260808 17:54:25.836913 29694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:25.837822 29807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:25.839816 29807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba: Bootstrap starting.
I20260808 17:54:25.840308 29807 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:25.840539 29807 log.cc:824] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:25.841114 29807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba: No bootstrap required, opened a new log
I20260808 17:54:25.842602 29807 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9716202386342528ea6b38c1696f0ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38163 } }
I20260808 17:54:25.842727 29807 raft_consensus.cc:374] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:25.842756 29807 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9716202386342528ea6b38c1696f0ba, State: Initialized, Role: FOLLOWER
I20260808 17:54:25.842861 29807 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9716202386342528ea6b38c1696f0ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38163 } }
I20260808 17:54:25.842911 29807 raft_consensus.cc:388] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:25.842929 29807 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:25.842957 29807 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:25.843410 29807 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9716202386342528ea6b38c1696f0ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38163 } }
I20260808 17:54:25.843493 29807 leader_election.cc:302] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f9716202386342528ea6b38c1696f0ba; no voters:
I20260808 17:54:25.843609 29807 leader_election.cc:288] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:25.843657 29810 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:25.843822 29807 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:25.843830 29810 raft_consensus.cc:686] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba [term 1 LEADER]: Becoming Leader. State: Replica: f9716202386342528ea6b38c1696f0ba, State: Running, Role: LEADER
I20260808 17:54:25.843940 29810 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9716202386342528ea6b38c1696f0ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38163 } }
I20260808 17:54:25.844280 29812 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9716202386342528ea6b38c1696f0ba. Latest consensus state: current_term: 1 leader_uuid: "f9716202386342528ea6b38c1696f0ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9716202386342528ea6b38c1696f0ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38163 } } }
I20260808 17:54:25.844379 29812 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:25.844282 29811 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f9716202386342528ea6b38c1696f0ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9716202386342528ea6b38c1696f0ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38163 } } }
I20260808 17:54:25.844458 29811 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:25.844811 29816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:25.845295 29816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:25.846323 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 29694
I20260808 17:54:25.846434 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:25.846617 29526 external_mini_cluster.cc:1428] Setting key ac769caefbc8cefa4552dbf54e8d0d64
I20260808 17:54:25.846702 29816 catalog_manager.cc:1347] Generated new cluster ID: 2e1fd5d58df1455a88f5839e9e6902a9
I20260808 17:54:25.846746 29816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:25.854704 29837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:25.847124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:57507 (local address 127.0.0.1:38163)
0808 17:54:25.853407 (+ 6283us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:25.853414 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:25.853439 (+ 25us) server_negotiation.cc:407] Connection header received
0808 17:54:25.853540 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:25.853545 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:25.853567 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:25.853686 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:25.854290 (+ 604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:25.854293 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:25.854294 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:25.854297 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:25.854332 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:25.854345 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:25.854399 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:25.854470 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 17:54:25.854514 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6247,"thread_start_us":65,"threads_started":1}
I20260808 17:54:25.855598 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:25.858429 29837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:25.857428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:33019 (local address 127.0.0.1:38163)
0808 17:54:25.857459 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:25.857461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:25.857649 (+ 188us) server_negotiation.cc:407] Connection header received
0808 17:54:25.857709 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:25.857710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:25.857716 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:25.857758 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:25.858233 (+ 475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:25.858234 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:25.858235 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:25.858238 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:25.858252 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:25.858256 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:25.858301 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:25.858349 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 17:54:25.858369 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260808 17:54:25.882392 29816 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:25.882560 29816 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:25.894222 29816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f9716202386342528ea6b38c1696f0ba: Generated new TSK 0
I20260808 17:54:25.894376 29816 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:25.900552 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 29694
2026-08-08T17:54:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1411 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:25 dist-test-slave-bndk krb5kdc[29846](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:25 dist-test-slave-bndk krb5kdc[29846](info): set up 2 sockets
Aug 08 17:54:25 dist-test-slave-bndk krb5kdc[29846](info): commencing operation
krb5kdc: starting...
W20260808 17:54:27.020159 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:27 dist-test-slave-bndk krb5kdc[29846](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:54:27.130152 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:36773
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:37751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:36773
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:27.208415 29860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:27.208599 29860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:27.208630 29860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:27.209789 29860 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:27.209829 29860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:27.209848 29860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:27.209863 29860 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:27.209880 29860 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:27.211328 29860 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:37751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:36773
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:36773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:27.211567 29860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:27.211771 29860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:27.216166 29867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:27.216200 29865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:27.216200 29870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:27.216400 29860 server_base.cc:1034] running on GCE node
I20260808 17:54:27.216591 29860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:27.216820 29860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:27.217947 29860 hybrid_clock.cc:648] HybridClock initialized: now 1786211667217925 us; error 36 us; skew 500 ppm
Aug 08 17:54:27 dist-test-slave-bndk krb5kdc[29846](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211667, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:27.224112 29860 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:54:27.224506 29860 webserver.cc:460] Webserver started at http://127.28.213.190:40203/ using document root <none> and password file <none>
I20260808 17:54:27.224697 29860 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:27.224736 29860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:27.224826 29860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:27.225822 29860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "85f55caa07e043378b718f699945c796"
format_stamp: "Formatted at 2026-08-08 17:54:27 on dist-test-slave-bndk"
server_key: "352affaa5a80af183ff92790d021189f"
server_key_iv: "19eae057dd60b203a7113c88386e56f4"
server_key_version: "encryptionkey@0"
I20260808 17:54:27.226110 29860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "85f55caa07e043378b718f699945c796"
format_stamp: "Formatted at 2026-08-08 17:54:27 on dist-test-slave-bndk"
server_key: "352affaa5a80af183ff92790d021189f"
server_key_iv: "19eae057dd60b203a7113c88386e56f4"
server_key_version: "encryptionkey@0"
I20260808 17:54:27.227250 29860 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:54:27.227849 29882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:27.228000 29860 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:27.228080 29860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "85f55caa07e043378b718f699945c796"
format_stamp: "Formatted at 2026-08-08 17:54:27 on dist-test-slave-bndk"
server_key: "352affaa5a80af183ff92790d021189f"
server_key_iv: "19eae057dd60b203a7113c88386e56f4"
server_key_version: "encryptionkey@0"
I20260808 17:54:27.228133 29860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:27.248199 29860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:27.250324 29860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:27.250450 29860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:27.254182 29860 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:36773
I20260808 17:54:27.254233 29961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:36773 every 8 connection(s)
I20260808 17:54:27.254541 29860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:27.255353 29962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:27.257561 29962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796: Bootstrap starting.
I20260808 17:54:27.258100 29962 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:27.258361 29962 log.cc:824] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:27.258999 29962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796: No bootstrap required, opened a new log
I20260808 17:54:27.260502 29962 raft_consensus.cc:348] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85f55caa07e043378b718f699945c796" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36773 } }
I20260808 17:54:27.260632 29962 raft_consensus.cc:374] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:27.260664 29962 raft_consensus.cc:729] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f55caa07e043378b718f699945c796, State: Initialized, Role: FOLLOWER
I20260808 17:54:27.260797 29962 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85f55caa07e043378b718f699945c796" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36773 } }
I20260808 17:54:27.260854 29962 raft_consensus.cc:388] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:27.260874 29962 raft_consensus.cc:482] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:27.260926 29962 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:27.261754 29962 raft_consensus.cc:504] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85f55caa07e043378b718f699945c796" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36773 } }
I20260808 17:54:27.261852 29962 leader_election.cc:302] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 85f55caa07e043378b718f699945c796; no voters:
I20260808 17:54:27.262009 29962 leader_election.cc:288] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:27.262040 29967 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:27.262180 29967 raft_consensus.cc:686] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796 [term 1 LEADER]: Becoming Leader. State: Replica: 85f55caa07e043378b718f699945c796, State: Running, Role: LEADER
I20260808 17:54:27.262224 29962 sys_catalog.cc:564] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:27.262270 29967 consensus_queue.cc:237] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85f55caa07e043378b718f699945c796" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36773 } }
I20260808 17:54:27.262612 29969 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "85f55caa07e043378b718f699945c796" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85f55caa07e043378b718f699945c796" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36773 } } }
I20260808 17:54:27.262617 29970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85f55caa07e043378b718f699945c796. Latest consensus state: current_term: 1 leader_uuid: "85f55caa07e043378b718f699945c796" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85f55caa07e043378b718f699945c796" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 36773 } } }
I20260808 17:54:27.262709 29969 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:27.262715 29970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:27.263028 29978 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:27.263495 29978 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:27.264452 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 29860
I20260808 17:54:27.264564 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:27.264761 29526 external_mini_cluster.cc:1428] Setting key 1f00d58070aa853215d30dbafa0b32b5
I20260808 17:54:27.265051 29978 catalog_manager.cc:1347] Generated new cluster ID: 96b73a714e4a4535bea127871178e329
I20260808 17:54:27.265106 29978 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:27.270275 29978 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:27.270810 29978 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:27.274471 29978 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 85f55caa07e043378b718f699945c796: Generated new TSK 0
I20260808 17:54:27.274631 29978 catalog_manager.cc:1514] Initializing in-progress tserver states...
Aug 08 17:54:27 dist-test-slave-bndk krb5kdc[29846](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:27.279146 29992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:27.265314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54229 (local address 127.28.213.190:36773)
0808 17:54:27.265467 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:27.265476 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:27.265505 (+ 29us) server_negotiation.cc:407] Connection header received
0808 17:54:27.265619 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:27.265625 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:27.265674 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:27.265795 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:27.266554 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:27.267883 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:27.268947 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:27.269933 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:27.270033 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:27.275470 (+ 5437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:27.275474 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:27.275474 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:27.275486 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:27.277028 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:27.277533 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:27.277537 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:27.277537 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:27.277647 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:27.277963 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:27.277964 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:27.277964 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:27.278379 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:27.278546 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:27.278763 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 17:54:27.278925 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":77,"threads_started":1}
I20260808 17:54:27.280879 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:27.288067 29992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:27.282129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57181 (local address 127.28.213.190:36773)
0808 17:54:27.282167 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:27.282169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:27.282242 (+ 73us) server_negotiation.cc:407] Connection header received
0808 17:54:27.282308 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:27.282308 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:27.282315 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:27.282355 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:27.282937 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:27.283524 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:27.284513 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:27.284704 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:27.284745 (+ 41us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:27.285968 (+ 1223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:27.285969 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:27.285969 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:27.285975 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:27.287099 (+ 1124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:27.287464 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:27.287464 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:27.287465 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:27.287508 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:27.287690 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:27.287691 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:27.287691 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:27.287766 (+ 75us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:27.287842 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:27.287972 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 17:54:27.288016 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:54:27.289752 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 29860
W20260808 17:54:27.301887 29844 connection.cc:535] client connection to 127.28.213.190:36773 recv error: Network error: failed to read from TLS socket (remote: 127.28.213.190:36773): Connection reset by peer (error 104)
2026-08-08T17:54:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1391 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:27 dist-test-slave-bndk krb5kdc[30004](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:27 dist-test-slave-bndk krb5kdc[30004](info): set up 2 sockets
Aug 08 17:54:27 dist-test-slave-bndk krb5kdc[30004](info): commencing operation
krb5kdc: starting...
W20260808 17:54:28.407599 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:28 dist-test-slave-bndk krb5kdc[30004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:54:28.517447 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:38909
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:39867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:38909
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:28.595589 30022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:28.595763 30022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:28.595783 30022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:28.596865 30022 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:28.596904 30022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:28.596916 30022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:28.596927 30022 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:28.596941 30022 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:28.598390 30022 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:39867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:38909
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:38909
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:28.598609 30022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:28.598815 30022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:28.603307 30033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:28.603302 30031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:28.603303 30029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:28.603628 30022 server_base.cc:1034] running on GCE node
I20260808 17:54:28.603859 30022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:28.604116 30022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:28.605299 30022 hybrid_clock.cc:648] HybridClock initialized: now 1786211668605284 us; error 27 us; skew 500 ppm
Aug 08 17:54:28 dist-test-slave-bndk krb5kdc[30004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211668, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:28.607566 30022 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:54:28.607913 30022 webserver.cc:460] Webserver started at http://127.28.213.190:38309/ using document root <none> and password file <none>
I20260808 17:54:28.608084 30022 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:28.608121 30022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:28.608278 30022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:28.609210 30022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "d3cde8440a7c48aa9ecab0e6af905a55"
format_stamp: "Formatted at 2026-08-08 17:54:28 on dist-test-slave-bndk"
server_key: "8f681c291da302f8459ea24e60ba83fa"
server_key_iv: "00f12712c113a7f730170332b2a898d7"
server_key_version: "encryptionkey@0"
I20260808 17:54:28.609549 30022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "d3cde8440a7c48aa9ecab0e6af905a55"
format_stamp: "Formatted at 2026-08-08 17:54:28 on dist-test-slave-bndk"
server_key: "8f681c291da302f8459ea24e60ba83fa"
server_key_iv: "00f12712c113a7f730170332b2a898d7"
server_key_version: "encryptionkey@0"
I20260808 17:54:28.610672 30022 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 17:54:28.611291 30046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:28.611433 30022 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:28.611514 30022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "d3cde8440a7c48aa9ecab0e6af905a55"
format_stamp: "Formatted at 2026-08-08 17:54:28 on dist-test-slave-bndk"
server_key: "8f681c291da302f8459ea24e60ba83fa"
server_key_iv: "00f12712c113a7f730170332b2a898d7"
server_key_version: "encryptionkey@0"
I20260808 17:54:28.611567 30022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:28.631608 30022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:28.633153 30022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:28.633291 30022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:28.636831 30022 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:38909
I20260808 17:54:28.636870 30131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:38909 every 8 connection(s)
I20260808 17:54:28.637166 30022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:28.637979 30132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:28.640054 30132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55: Bootstrap starting.
I20260808 17:54:28.640578 30132 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:28.640841 30132 log.cc:824] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:28.641464 30132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55: No bootstrap required, opened a new log
I20260808 17:54:28.641588 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 30022
I20260808 17:54:28.641687 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:28.641872 29526 external_mini_cluster.cc:1428] Setting key a5423603378928d26fb488644a90a9d0
I20260808 17:54:28.643432 30132 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3cde8440a7c48aa9ecab0e6af905a55" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38909 } }
I20260808 17:54:28.643599 30132 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:28.643646 30132 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cde8440a7c48aa9ecab0e6af905a55, State: Initialized, Role: FOLLOWER
I20260808 17:54:28.643767 30132 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3cde8440a7c48aa9ecab0e6af905a55" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38909 } }
I20260808 17:54:28.643844 30132 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:28.643883 30132 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:28.643932 30132 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:28.644438 30132 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3cde8440a7c48aa9ecab0e6af905a55" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38909 } }
I20260808 17:54:28.644531 30132 leader_election.cc:302] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3cde8440a7c48aa9ecab0e6af905a55; no voters:
I20260808 17:54:28.644686 30132 leader_election.cc:288] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:28.644721 30138 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:28.644824 30138 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55 [term 1 LEADER]: Becoming Leader. State: Replica: d3cde8440a7c48aa9ecab0e6af905a55, State: Running, Role: LEADER
I20260808 17:54:28.644906 30138 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3cde8440a7c48aa9ecab0e6af905a55" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38909 } }
I20260808 17:54:28.644940 30132 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:28.645257 30138 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3cde8440a7c48aa9ecab0e6af905a55. Latest consensus state: current_term: 1 leader_uuid: "d3cde8440a7c48aa9ecab0e6af905a55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3cde8440a7c48aa9ecab0e6af905a55" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38909 } } }
I20260808 17:54:28.645329 30138 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:28.645498 30139 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3cde8440a7c48aa9ecab0e6af905a55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3cde8440a7c48aa9ecab0e6af905a55" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 38909 } } }
I20260808 17:54:28.645563 30139 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:28.645684 30146 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:28.646320 30146 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:28.648090 30146 catalog_manager.cc:1347] Generated new cluster ID: a3e27cc481a8415bb452479f4f38cd2b
I20260808 17:54:28.648154 30146 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:28.648255 30137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:28.642305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59551 (local address 127.28.213.190:38909)
0808 17:54:28.642479 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:28.642488 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:28.642520 (+ 32us) server_negotiation.cc:407] Connection header received
0808 17:54:28.643404 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:28.643413 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:28.643479 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:28.643623 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:28.643821 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:28.645161 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:28.646283 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:28.646857 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:28.646954 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:28.647589 (+ 635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:28.647593 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:28.647593 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:28.647772 (+ 179us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:28.647799 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:28.647810 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:28.647881 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:28.647971 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 17:54:28.647999 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":76,"threads_started":1}
I20260808 17:54:28.649113 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:28.652897 30137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:28.650373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54093 (local address 127.28.213.190:38909)
0808 17:54:28.650412 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:28.650414 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:28.650522 (+ 108us) server_negotiation.cc:407] Connection header received
0808 17:54:28.650571 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:28.650572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:28.650582 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:28.650625 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:28.650740 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:28.651178 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:28.651851 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:28.652085 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:28.652139 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:28.652681 (+ 542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:28.652682 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:28.652682 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:28.652686 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:28.652699 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:28.652703 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:28.652752 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:28.652818 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 17:54:28.652829 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 17:54:28.676141 30146 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:28.676738 30146 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:28.678949 30146 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3cde8440a7c48aa9ecab0e6af905a55: Generated new TSK 0
I20260808 17:54:28.679108 30146 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:28.685593 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 30022
W20260808 17:54:28.700381 30001 connection.cc:535] client connection to 127.28.213.190:38909 recv error: Network error: failed to read from TLS socket (remote: 127.28.213.190:38909): Connection reset by peer (error 104)
2026-08-08T17:54:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1398 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:28 dist-test-slave-bndk krb5kdc[30173](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:28 dist-test-slave-bndk krb5kdc[30173](info): set up 2 sockets
Aug 08 17:54:28 dist-test-slave-bndk krb5kdc[30173](info): commencing operation
krb5kdc: starting...
W20260808 17:54:29.808347 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:29 dist-test-slave-bndk krb5kdc[30173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:54:29.919483 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:42139
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:40269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:42139
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:29.997836 30195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:29.998028 30195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:29.998059 30195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:29.999163 30195 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:29.999203 30195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:29.999219 30195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:29.999235 30195 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:29.999250 30195 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:30.000679 30195 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:40269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:42139
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:42139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30195
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:30.000916 30195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:30.001116 30195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 17:54:30.005642 30195 server_base.cc:1034] running on GCE node
W20260808 17:54:30.005684 30203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:30.005738 30202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:30.005650 30205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:30.006053 30195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:30.006335 30195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:30.007490 30195 hybrid_clock.cc:648] HybridClock initialized: now 1786211670007477 us; error 29 us; skew 500 ppm
Aug 08 17:54:30 dist-test-slave-bndk krb5kdc[30173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211670, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:30.009816 30195 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:54:30.010200 30195 webserver.cc:460] Webserver started at http://127.28.213.190:34487/ using document root <none> and password file <none>
I20260808 17:54:30.010402 30195 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:30.010452 30195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:30.010577 30195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:30.011566 30195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "bd69d0abda8a410aaf479d7f8999e193"
format_stamp: "Formatted at 2026-08-08 17:54:30 on dist-test-slave-bndk"
server_key: "d25443c6eed8e5fc8bf78c7161b95cd5"
server_key_iv: "904afc0cfd23cb16982c3a4c75a65074"
server_key_version: "encryptionkey@0"
I20260808 17:54:30.011889 30195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "bd69d0abda8a410aaf479d7f8999e193"
format_stamp: "Formatted at 2026-08-08 17:54:30 on dist-test-slave-bndk"
server_key: "d25443c6eed8e5fc8bf78c7161b95cd5"
server_key_iv: "904afc0cfd23cb16982c3a4c75a65074"
server_key_version: "encryptionkey@0"
I20260808 17:54:30.013162 30195 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 17:54:30.013842 30215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:30.013998 30195 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:30.014083 30195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "bd69d0abda8a410aaf479d7f8999e193"
format_stamp: "Formatted at 2026-08-08 17:54:30 on dist-test-slave-bndk"
server_key: "d25443c6eed8e5fc8bf78c7161b95cd5"
server_key_iv: "904afc0cfd23cb16982c3a4c75a65074"
server_key_version: "encryptionkey@0"
I20260808 17:54:30.014153 30195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:30.017323 30195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:30.018921 30195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:30.019043 30195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:30.022747 30195 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:42139
I20260808 17:54:30.022783 30294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:42139 every 8 connection(s)
I20260808 17:54:30.023061 30195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:30.023433 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 30195
I20260808 17:54:30.023561 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:30.023763 29526 external_mini_cluster.cc:1428] Setting key f87e69ecc4f2cfd6a1dda65b4b9376ff
I20260808 17:54:30.024138 30297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:30.025959 30300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:30.024235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45669 (local address 127.28.213.190:42139)
0808 17:54:30.024411 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:30.024420 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:30.024444 (+ 24us) server_negotiation.cc:407] Connection header received
0808 17:54:30.024825 (+ 381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:30.024831 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:30.024861 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:30.024965 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:30.025576 (+ 611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:30.025579 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:30.025579 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:30.025582 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:30.025622 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:30.025631 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:30.025684 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:30.025755 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 17:54:30.025785 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":79,"threads_started":1}
I20260808 17:54:30.026845 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:30.027179 30297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193: Bootstrap starting.
I20260808 17:54:30.027716 30297 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:30.028033 30297 log.cc:824] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:30.028694 30297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193: No bootstrap required, opened a new log
I20260808 17:54:30.028991 30300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:30.028109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59713 (local address 127.28.213.190:42139)
0808 17:54:30.028144 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:30.028146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:30.028247 (+ 101us) server_negotiation.cc:407] Connection header received
0808 17:54:30.028303 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:30.028304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:30.028309 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:30.028358 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:30.028817 (+ 459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:30.028818 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:30.028818 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:30.028823 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:30.028834 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:30.028837 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:30.028882 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:30.028923 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 17:54:30.028933 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:54:30.030568 30297 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd69d0abda8a410aaf479d7f8999e193" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 42139 } }
I20260808 17:54:30.030692 30297 raft_consensus.cc:374] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:30.030714 30297 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd69d0abda8a410aaf479d7f8999e193, State: Initialized, Role: FOLLOWER
I20260808 17:54:30.030826 30297 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd69d0abda8a410aaf479d7f8999e193" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 42139 } }
I20260808 17:54:30.030900 30297 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:30.030923 30297 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:30.030969 30297 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:30.031471 30297 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd69d0abda8a410aaf479d7f8999e193" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 42139 } }
I20260808 17:54:30.031558 30297 leader_election.cc:302] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd69d0abda8a410aaf479d7f8999e193; no voters:
I20260808 17:54:30.031705 30297 leader_election.cc:288] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:30.031745 30314 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:30.031908 30297 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:30.031919 30314 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193 [term 1 LEADER]: Becoming Leader. State: Replica: bd69d0abda8a410aaf479d7f8999e193, State: Running, Role: LEADER
I20260808 17:54:30.032105 30314 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd69d0abda8a410aaf479d7f8999e193" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 42139 } }
I20260808 17:54:30.032457 30316 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd69d0abda8a410aaf479d7f8999e193. Latest consensus state: current_term: 1 leader_uuid: "bd69d0abda8a410aaf479d7f8999e193" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd69d0abda8a410aaf479d7f8999e193" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 42139 } } }
I20260808 17:54:30.032465 30315 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd69d0abda8a410aaf479d7f8999e193" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd69d0abda8a410aaf479d7f8999e193" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 42139 } } }
I20260808 17:54:30.032636 30316 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:30.032650 30315 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:30.033011 30328 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:30.033509 30328 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:30.035000 30328 catalog_manager.cc:1347] Generated new cluster ID: 6b6f50b99d4f4e8b9781f7aba4fa98af
I20260808 17:54:30.035053 30328 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:30.049348 30328 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:30.049489 30328 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:30.060468 30328 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd69d0abda8a410aaf479d7f8999e193: Generated new TSK 0
I20260808 17:54:30.060699 30328 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:30.070246 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 30195
2026-08-08T17:54:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1384 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:30 dist-test-slave-bndk krb5kdc[30346](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:30 dist-test-slave-bndk krb5kdc[30346](info): set up 2 sockets
Aug 08 17:54:30 dist-test-slave-bndk krb5kdc[30346](info): commencing operation
krb5kdc: starting...
W20260808 17:54:31.189129 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:31 dist-test-slave-bndk krb5kdc[30346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211671, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:54:31.301767 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:39595
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:37021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:39595
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:31.385270 30366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:31.385568 30366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:31.385622 30366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:31.387343 30366 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:31.387403 30366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:31.387424 30366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:31.387450 30366 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:31.387468 30366 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:31.389649 30366 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:37021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:39595
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:39595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:31.389921 30366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:31.390178 30366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:31.395107 30381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:31.395125 30376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:31.395159 30377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:31.395155 30366 server_base.cc:1034] running on GCE node
I20260808 17:54:31.395556 30366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:31.395885 30366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:31.397063 30366 hybrid_clock.cc:648] HybridClock initialized: now 1786211671397042 us; error 35 us; skew 500 ppm
Aug 08 17:54:31 dist-test-slave-bndk krb5kdc[30346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211671, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:31.400228 30366 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:54:31.400775 30366 webserver.cc:460] Webserver started at http://127.28.213.190:41375/ using document root <none> and password file <none>
I20260808 17:54:31.401028 30366 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:31.401093 30366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:31.401257 30366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:31.402702 30366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "428cc19ad48645939c290b0f5548d74a"
format_stamp: "Formatted at 2026-08-08 17:54:31 on dist-test-slave-bndk"
server_key: "220e1ea80d07afc9c3f8cf40f3fe9c84"
server_key_iv: "f75d3071e66e66e8ce8fb15afe5b0b3a"
server_key_version: "encryptionkey@0"
I20260808 17:54:31.403128 30366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "428cc19ad48645939c290b0f5548d74a"
format_stamp: "Formatted at 2026-08-08 17:54:31 on dist-test-slave-bndk"
server_key: "220e1ea80d07afc9c3f8cf40f3fe9c84"
server_key_iv: "f75d3071e66e66e8ce8fb15afe5b0b3a"
server_key_version: "encryptionkey@0"
I20260808 17:54:31.404850 30366 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:54:31.405676 30390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:31.405864 30366 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:31.405954 30366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "428cc19ad48645939c290b0f5548d74a"
format_stamp: "Formatted at 2026-08-08 17:54:31 on dist-test-slave-bndk"
server_key: "220e1ea80d07afc9c3f8cf40f3fe9c84"
server_key_iv: "f75d3071e66e66e8ce8fb15afe5b0b3a"
server_key_version: "encryptionkey@0"
I20260808 17:54:31.406018 30366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:31.425637 30366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:31.427958 30366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:31.428089 30366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:31.431831 30366 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:39595
I20260808 17:54:31.431901 30464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:39595 every 8 connection(s)
I20260808 17:54:31.432202 30366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:31.433211 30465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:31.436501 30465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a: Bootstrap starting.
I20260808 17:54:31.437259 30465 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:31.437425 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 30366
I20260808 17:54:31.437525 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:31.437650 30465 log.cc:824] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:31.437695 29526 external_mini_cluster.cc:1428] Setting key 08243482272d85e3e9d2e56ad9d4b6ae
I20260808 17:54:31.438457 30465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a: No bootstrap required, opened a new log
I20260808 17:54:31.440827 30465 raft_consensus.cc:348] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "428cc19ad48645939c290b0f5548d74a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39595 } }
I20260808 17:54:31.441013 30465 raft_consensus.cc:374] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:31.441076 30465 raft_consensus.cc:729] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428cc19ad48645939c290b0f5548d74a, State: Initialized, Role: FOLLOWER
I20260808 17:54:31.441237 30465 consensus_queue.cc:260] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "428cc19ad48645939c290b0f5548d74a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39595 } }
I20260808 17:54:31.441326 30465 raft_consensus.cc:388] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:31.441375 30465 raft_consensus.cc:482] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:31.441427 30465 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:31.442502 30465 raft_consensus.cc:504] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "428cc19ad48645939c290b0f5548d74a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39595 } }
I20260808 17:54:31.442608 30465 leader_election.cc:302] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 428cc19ad48645939c290b0f5548d74a; no voters:
I20260808 17:54:31.442781 30465 leader_election.cc:288] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:31.442876 30470 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:31.443028 30465 sys_catalog.cc:564] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:31.443040 30470 raft_consensus.cc:686] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a [term 1 LEADER]: Becoming Leader. State: Replica: 428cc19ad48645939c290b0f5548d74a, State: Running, Role: LEADER
I20260808 17:54:31.443248 30470 consensus_queue.cc:237] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "428cc19ad48645939c290b0f5548d74a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39595 } }
I20260808 17:54:31.443678 30471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "428cc19ad48645939c290b0f5548d74a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "428cc19ad48645939c290b0f5548d74a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39595 } } }
I20260808 17:54:31.443774 30471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:31.443696 30472 sys_catalog.cc:455] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 428cc19ad48645939c290b0f5548d74a. Latest consensus state: current_term: 1 leader_uuid: "428cc19ad48645939c290b0f5548d74a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "428cc19ad48645939c290b0f5548d74a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39595 } } }
I20260808 17:54:31.444169 30472 sys_catalog.cc:458] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:31.444487 30485 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:31.444994 30485 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:31.446563 30485 catalog_manager.cc:1347] Generated new cluster ID: d9309543978144e69b941b3f456fb76c
I20260808 17:54:31.446612 30485 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 17:54:31 dist-test-slave-bndk krb5kdc[30346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211671, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:31.452260 30469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:31.438115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54957 (local address 127.28.213.190:39595)
0808 17:54:31.438274 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:31.438282 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:31.441308 (+ 3026us) server_negotiation.cc:407] Connection header received
0808 17:54:31.441565 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:31.441571 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:31.441620 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:31.441736 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:31.442360 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:31.443560 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:31.444598 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:31.445097 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:31.445195 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:31.448285 (+ 3090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:31.448289 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:31.448290 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:31.448301 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:31.450219 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:31.450605 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:31.450609 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:31.450609 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:31.450729 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:31.450956 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:31.450957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:31.450958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:31.451269 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:31.451443 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:31.451928 (+ 485us) server_negotiation.cc:299] Negotiation successful
0808 17:54:31.452066 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":71,"threads_started":1}
I20260808 17:54:31.453521 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:31.461681 30469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:31.454853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53577 (local address 127.28.213.190:39595)
0808 17:54:31.454883 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:31.454885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:31.454892 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:54:31.454912 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:31.454913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:31.454922 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:31.454973 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:31.455603 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:31.456330 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:31.457361 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:31.457659 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:31.457696 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:31.459047 (+ 1351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:31.459048 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:31.459048 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:31.459055 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:31.460502 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:31.460879 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:31.460880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:31.460880 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:31.460932 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:31.461117 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:31.461118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:31.461118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:31.461249 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:31.461325 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:31.461526 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 17:54:31.461599 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 17:54:31.471949 30485 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:31.472656 30485 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:31.480386 30485 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 428cc19ad48645939c290b0f5548d74a: Generated new TSK 0
I20260808 17:54:31.480551 30485 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:31.485061 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 30366
2026-08-08T17:54:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1418 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:31 dist-test-slave-bndk krb5kdc[30508](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:31 dist-test-slave-bndk krb5kdc[30508](info): set up 2 sockets
Aug 08 17:54:31 dist-test-slave-bndk krb5kdc[30508](info): commencing operation
krb5kdc: starting...
W20260808 17:54:32.626051 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:32 dist-test-slave-bndk krb5kdc[30508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211672, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:54:32.735919 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:35201
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:36125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:35201
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:32.815125 30524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:32.815318 30524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:32.815349 30524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:32.816457 30524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:32.816496 30524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:32.816514 30524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:32.816530 30524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:32.816545 30524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:32.818058 30524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:36125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:35201
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:35201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:32.818300 30524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:32.818506 30524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:32.822932 30531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:32.822942 30541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:32.822938 30533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:32.823210 30524 server_base.cc:1034] running on GCE node
I20260808 17:54:32.823443 30524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:32.823695 30524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:32.824827 30524 hybrid_clock.cc:648] HybridClock initialized: now 1786211672824808 us; error 37 us; skew 500 ppm
Aug 08 17:54:32 dist-test-slave-bndk krb5kdc[30508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211672, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:32.831700 30524 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:54:32.832099 30524 webserver.cc:460] Webserver started at http://127.28.213.190:44373/ using document root <none> and password file <none>
I20260808 17:54:32.832309 30524 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:32.832350 30524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:32.832471 30524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:32.833473 30524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "2db5461ebeb447aab66410643f9763fa"
format_stamp: "Formatted at 2026-08-08 17:54:32 on dist-test-slave-bndk"
server_key: "fabd5c54a64bee07b3c9243bd3da0239"
server_key_iv: "d7f463ac87494f8493ffca2f901c6c1a"
server_key_version: "encryptionkey@0"
I20260808 17:54:32.833776 30524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "2db5461ebeb447aab66410643f9763fa"
format_stamp: "Formatted at 2026-08-08 17:54:32 on dist-test-slave-bndk"
server_key: "fabd5c54a64bee07b3c9243bd3da0239"
server_key_iv: "d7f463ac87494f8493ffca2f901c6c1a"
server_key_version: "encryptionkey@0"
I20260808 17:54:32.834964 30524 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:54:32.835577 30552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:32.835721 30524 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:32.835804 30524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "2db5461ebeb447aab66410643f9763fa"
format_stamp: "Formatted at 2026-08-08 17:54:32 on dist-test-slave-bndk"
server_key: "fabd5c54a64bee07b3c9243bd3da0239"
server_key_iv: "d7f463ac87494f8493ffca2f901c6c1a"
server_key_version: "encryptionkey@0"
I20260808 17:54:32.835862 30524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:32.866617 30524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:32.868376 30524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:32.868516 30524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:32.872380 30524 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:35201
I20260808 17:54:32.872411 30633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:35201 every 8 connection(s)
I20260808 17:54:32.872740 30524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:32.873579 30634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:32.875762 30634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa: Bootstrap starting.
I20260808 17:54:32.876281 30634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:32.876530 30634 log.cc:824] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:32.877133 30634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa: No bootstrap required, opened a new log
I20260808 17:54:32.878675 30634 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2db5461ebeb447aab66410643f9763fa" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35201 } }
I20260808 17:54:32.878811 30634 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:32.878834 30634 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db5461ebeb447aab66410643f9763fa, State: Initialized, Role: FOLLOWER
I20260808 17:54:32.878947 30634 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2db5461ebeb447aab66410643f9763fa" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35201 } }
I20260808 17:54:32.879024 30634 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:32.879050 30634 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:32.879081 30634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:32.879858 30634 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2db5461ebeb447aab66410643f9763fa" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35201 } }
I20260808 17:54:32.879944 30634 leader_election.cc:302] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2db5461ebeb447aab66410643f9763fa; no voters:
I20260808 17:54:32.880064 30634 leader_election.cc:288] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:32.880115 30638 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:32.880288 30634 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:32.880291 30638 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa [term 1 LEADER]: Becoming Leader. State: Replica: 2db5461ebeb447aab66410643f9763fa, State: Running, Role: LEADER
I20260808 17:54:32.880445 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 30524
I20260808 17:54:32.880483 30638 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2db5461ebeb447aab66410643f9763fa" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35201 } }
I20260808 17:54:32.880582 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:32.880796 29526 external_mini_cluster.cc:1428] Setting key d097767e8c61c42d99e30e11f9f02813
I20260808 17:54:32.880827 30639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2db5461ebeb447aab66410643f9763fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2db5461ebeb447aab66410643f9763fa" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35201 } } }
I20260808 17:54:32.880904 30639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:32.881065 30640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2db5461ebeb447aab66410643f9763fa. Latest consensus state: current_term: 1 leader_uuid: "2db5461ebeb447aab66410643f9763fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2db5461ebeb447aab66410643f9763fa" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35201 } } }
I20260808 17:54:32.881145 30640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:32.881954 30647 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:32.882551 30647 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:32.883991 30647 catalog_manager.cc:1347] Generated new cluster ID: 116e321245e540f3818f6b381b163b07
I20260808 17:54:32.884034 30647 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:32.886624 30654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:32.881457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60791 (local address 127.28.213.190:35201)
0808 17:54:32.881601 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:32.881611 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:32.881648 (+ 37us) server_negotiation.cc:407] Connection header received
0808 17:54:32.881764 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:32.881772 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:32.881830 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:32.882048 (+ 218us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:32.882250 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:32.883457 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:32.884548 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:32.885137 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:32.885256 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:32.885946 (+ 690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:32.885951 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:32.885951 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:32.886153 (+ 202us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:32.886189 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:32.886202 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:32.886269 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:32.886349 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 17:54:32.886424 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":72,"threads_started":1}
I20260808 17:54:32.887727 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:32.888489 30647 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:32.889087 30647 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:32.891780 30647 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2db5461ebeb447aab66410643f9763fa: Generated new TSK 0
I20260808 17:54:32.892151 30647 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:32.892464 30654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:32.889158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48069 (local address 127.28.213.190:35201)
0808 17:54:32.889190 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:32.889191 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:32.889328 (+ 137us) server_negotiation.cc:407] Connection header received
0808 17:54:32.889387 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:32.889388 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:32.889397 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:32.889449 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:32.889567 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:32.890312 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:32.891339 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:32.891609 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:32.891661 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:32.892240 (+ 579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:32.892241 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:32.892242 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:32.892253 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:32.892267 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:32.892270 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:32.892297 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:32.892396 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 17:54:32.892418 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":9,"server-negotiator.queue_time_us":16}
I20260808 17:54:32.894086 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 30524
2026-08-08T17:54:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1408 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:32 dist-test-slave-bndk krb5kdc[30675](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:32 dist-test-slave-bndk krb5kdc[30675](info): set up 2 sockets
Aug 08 17:54:32 dist-test-slave-bndk krb5kdc[30675](info): commencing operation
krb5kdc: starting...
W20260808 17:54:34.020671 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:34 dist-test-slave-bndk krb5kdc[30675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211674, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:54:34.130095 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:39429
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:35613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:39429
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:34.211824 30693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:34.212018 30693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:34.212039 30693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:34.213155 30693 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:34.213195 30693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:34.213208 30693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:34.213255 30693 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:34.213272 30693 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:34.214761 30693 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:35613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:39429
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:39429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:34.214994 30693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:34.215194 30693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:34.219652 30699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:34.219659 30700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:34.219739 30693 server_base.cc:1034] running on GCE node
W20260808 17:54:34.219660 30705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:34.220116 30693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:34.220443 30693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:34.221588 30693 hybrid_clock.cc:648] HybridClock initialized: now 1786211674221571 us; error 32 us; skew 500 ppm
Aug 08 17:54:34 dist-test-slave-bndk krb5kdc[30675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211674, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:34.223922 30693 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:54:34.224290 30693 webserver.cc:460] Webserver started at http://127.28.213.190:46727/ using document root <none> and password file <none>
I20260808 17:54:34.224488 30693 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:34.224527 30693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:34.224618 30693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:34.225634 30693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "b3e3a542983c43de99a44cd735b528ba"
format_stamp: "Formatted at 2026-08-08 17:54:34 on dist-test-slave-bndk"
server_key: "0fe3ce6c3300ff814c1f78284581362f"
server_key_iv: "e2bbcb6d333f7fa16f2d353afbb79f54"
server_key_version: "encryptionkey@0"
I20260808 17:54:34.225924 30693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "b3e3a542983c43de99a44cd735b528ba"
format_stamp: "Formatted at 2026-08-08 17:54:34 on dist-test-slave-bndk"
server_key: "0fe3ce6c3300ff814c1f78284581362f"
server_key_iv: "e2bbcb6d333f7fa16f2d353afbb79f54"
server_key_version: "encryptionkey@0"
I20260808 17:54:34.227111 30693 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:54:34.227730 30715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:34.227876 30693 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:34.227954 30693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "b3e3a542983c43de99a44cd735b528ba"
format_stamp: "Formatted at 2026-08-08 17:54:34 on dist-test-slave-bndk"
server_key: "0fe3ce6c3300ff814c1f78284581362f"
server_key_iv: "e2bbcb6d333f7fa16f2d353afbb79f54"
server_key_version: "encryptionkey@0"
I20260808 17:54:34.228018 30693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:34.231129 30693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:34.233079 30693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:34.233201 30693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:34.236877 30693 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:39429
I20260808 17:54:34.236908 30791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:39429 every 8 connection(s)
I20260808 17:54:34.237181 30693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:34.238143 30792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:34.240192 30792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba: Bootstrap starting.
I20260808 17:54:34.240697 30792 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:34.240926 30792 log.cc:824] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:34.241537 30792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba: No bootstrap required, opened a new log
I20260808 17:54:34.243043 30792 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3e3a542983c43de99a44cd735b528ba" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39429 } }
I20260808 17:54:34.243170 30792 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 17:54:34.243197 30792 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3e3a542983c43de99a44cd735b528ba, State: Initialized, Role: FOLLOWER
I20260808 17:54:34.243300 30792 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3e3a542983c43de99a44cd735b528ba" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39429 } }
I20260808 17:54:34.243372 30792 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 17:54:34.243399 30792 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 17:54:34.243433 30792 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:34.244176 30792 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3e3a542983c43de99a44cd735b528ba" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39429 } }
I20260808 17:54:34.244261 30792 leader_election.cc:302] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3e3a542983c43de99a44cd735b528ba; no voters:
I20260808 17:54:34.244374 30792 leader_election.cc:288] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 17:54:34.244415 30798 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:34.244560 30798 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba [term 1 LEADER]: Becoming Leader. State: Replica: b3e3a542983c43de99a44cd735b528ba, State: Running, Role: LEADER
I20260808 17:54:34.244591 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 30693
I20260808 17:54:34.244611 30792 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:34.244700 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:34.244688 30798 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3e3a542983c43de99a44cd735b528ba" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39429 } }
I20260808 17:54:34.244937 29526 external_mini_cluster.cc:1428] Setting key 25c9e446192ad5ab663552026fab1c05
I20260808 17:54:34.244994 30798 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3e3a542983c43de99a44cd735b528ba. Latest consensus state: current_term: 1 leader_uuid: "b3e3a542983c43de99a44cd735b528ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3e3a542983c43de99a44cd735b528ba" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39429 } } }
I20260808 17:54:34.245056 30798 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:34.245201 30800 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3e3a542983c43de99a44cd735b528ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3e3a542983c43de99a44cd735b528ba" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 39429 } } }
I20260808 17:54:34.245270 30800 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:34.245870 30806 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:34.246349 30806 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:34.247817 30806 catalog_manager.cc:1347] Generated new cluster ID: 4229d07b49cd40afa0069693fdcd3f57
I20260808 17:54:34.247874 30817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:34.245604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55303 (local address 127.28.213.190:39429)
0808 17:54:34.245793 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:34.245802 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:34.246480 (+ 678us) server_negotiation.cc:407] Connection header received
0808 17:54:34.246582 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:34.246587 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:34.246609 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:34.246752 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:34.247477 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:34.247481 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:34.247481 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:34.247484 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:34.247517 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:34.247527 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:34.247580 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:34.247659 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 17:54:34.247699 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":90,"threads_started":1}
I20260808 17:54:34.247865 30806 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:34.248805 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:34.254432 30817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:34.253501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49875 (local address 127.28.213.190:39429)
0808 17:54:34.253534 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:34.253536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:34.253659 (+ 123us) server_negotiation.cc:407] Connection header received
0808 17:54:34.253714 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:34.253715 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:34.253720 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:34.253764 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:34.254245 (+ 481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:34.254247 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:34.254247 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 17:54:34.254251 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:34.254264 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 17:54:34.254269 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:34.254313 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:34.254363 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 17:54:34.254375 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:54:34.265066 30806 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:34.265240 30806 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:34.271492 30806 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3e3a542983c43de99a44cd735b528ba: Generated new TSK 0
I20260808 17:54:34.271654 30806 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 17:54:34.274235 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 30693
2026-08-08T17:54:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1372 ms)
[----------] 18 tests from AuthTokenIssuingTest (25068 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:34 dist-test-slave-bndk krb5kdc[30844](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:34 dist-test-slave-bndk krb5kdc[30844](info): set up 2 sockets
Aug 08 17:54:34 dist-test-slave-bndk krb5kdc[30844](info): commencing operation
krb5kdc: starting...
W20260808 17:54:35.403642 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:35 dist-test-slave-bndk krb5kdc[30844](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211675, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:54:35.526093 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:35713
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:46707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:35713,127.28.213.189:38071,127.28.213.188:36705
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:35.603914 30861 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 17:54:35.604110 30861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:35.604135 30861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:35.604158 30861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:35.605321 30861 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:35.605360 30861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:35.605377 30861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:35.605393 30861 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:35.605417 30861 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:35.606882 30861 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:46707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:35713,127.28.213.189:38071,127.28.213.188:36705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:35713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30861
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:35.607115 30861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:35.607311 30861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:35.611742 30867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:35.611721 30876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:35.611907 30861 server_base.cc:1034] running on GCE node
W20260808 17:54:35.611732 30869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:35.612195 30861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:35.612488 30861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:35.613621 30861 hybrid_clock.cc:648] HybridClock initialized: now 1786211675613608 us; error 29 us; skew 500 ppm
Aug 08 17:54:35 dist-test-slave-bndk krb5kdc[30844](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211675, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:35.615808 30861 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:54:35.616201 30861 webserver.cc:460] Webserver started at http://127.28.213.190:46865/ using document root <none> and password file <none>
I20260808 17:54:35.616412 30861 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:35.616462 30861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:35.616578 30861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:35.617588 30861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "7c0e40c5d77c40ac9aaa2d5157028739"
format_stamp: "Formatted at 2026-08-08 17:54:35 on dist-test-slave-bndk"
server_key: "8beac7664f33acc3cba75ab1ba2fa6d6"
server_key_iv: "5400d99ff38e86c9b775a3e39dcecdce"
server_key_version: "encryptionkey@0"
I20260808 17:54:35.617894 30861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "7c0e40c5d77c40ac9aaa2d5157028739"
format_stamp: "Formatted at 2026-08-08 17:54:35 on dist-test-slave-bndk"
server_key: "8beac7664f33acc3cba75ab1ba2fa6d6"
server_key_iv: "5400d99ff38e86c9b775a3e39dcecdce"
server_key_version: "encryptionkey@0"
I20260808 17:54:35.619074 30861 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:54:35.619714 30884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:35.619930 30861 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:35.620011 30861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "7c0e40c5d77c40ac9aaa2d5157028739"
format_stamp: "Formatted at 2026-08-08 17:54:35 on dist-test-slave-bndk"
server_key: "8beac7664f33acc3cba75ab1ba2fa6d6"
server_key_iv: "5400d99ff38e86c9b775a3e39dcecdce"
server_key_version: "encryptionkey@0"
I20260808 17:54:35.620062 30861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:35.639576 30861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:35.641152 30861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:35.641289 30861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:35.644881 30861 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:35713
I20260808 17:54:35.644936 30964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:35713 every 8 connection(s)
I20260808 17:54:35.645234 30861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:35.646039 30965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:35.647389 30965 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:54:35.650229 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 30861
I20260808 17:54:35.650305 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:35.650482 29526 external_mini_cluster.cc:1428] Setting key a1c0ed4c651986e9e18d709b90058cfc
Aug 08 17:54:35 dist-test-slave-bndk krb5kdc[30844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211675, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:35.656246 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.647923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:35713 (local address 127.0.0.1:36528)
0808 17:54:35.648083 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.648120 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:35.648544 (+ 424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:35.648762 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:35.648764 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:35.648980 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:35.649128 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:35.649132 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.650076 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.650077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:35.650797 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:35.650800 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.651234 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.651235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:35.651314 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:35.651725 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:35.651733 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:35.653178 (+ 1445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:35.654917 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:35.654924 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:35.654926 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:35.655155 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:35.655399 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:35.655399 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:35.655399 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:35.655477 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:35.655864 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:35.655870 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:35.655923 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 17:54:35.655990 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 17:54:35.656104 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":64,"threads_started":1}
I20260808 17:54:35.656313 30970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.647970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36528 (local address 127.28.213.190:35713)
0808 17:54:35.648104 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:35.648114 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:35.648183 (+ 69us) server_negotiation.cc:407] Connection header received
0808 17:54:35.648654 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:35.648655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:35.648671 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:35.648745 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:35.649192 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.649998 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.650870 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.651164 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.651260 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:35.653265 (+ 2005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:35.653274 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:35.653274 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:35.653280 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:35.654834 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.655233 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.655237 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.655237 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.655336 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.655531 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.655532 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.655532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.655794 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:35.655883 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:35.656045 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 17:54:35.656183 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":102,"thread_start_us":63,"threads_started":1}
I20260808 17:54:35.656919 30965 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:54:35.657228 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.657116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:38071 (local address 127.0.0.1:59904)
0808 17:54:35.657155 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.657195 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.189:38071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 17:54:35.657335 30888 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.213.189:38071: connect: Connection refused (error 111)
I20260808 17:54:35.657675 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.657596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:38071 (local address 127.0.0.1:59920)
0808 17:54:35.657631 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.657654 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.189:38071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 17:54:35.657757 30965 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.189:38071: Network error: Client connection negotiation failed: client connection to 127.28.213.189:38071: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.28.213.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.189.keytab.
Entry for principal kudu/127.28.213.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.189.keytab.
I20260808 17:54:35.673641 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.189:38071
--webserver_interface=127.28.213.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.189.keytab
--principal=kudu/127.28.213.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:46707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:35713,127.28.213.189:38071,127.28.213.188:36705
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:54:35.706931 30965 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } attempt: 1
I20260808 17:54:35.707301 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.707198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:38071 (local address 127.0.0.1:59922)
0808 17:54:35.707245 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.707274 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.189:38071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 17:54:35.707578 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.707504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:38071 (local address 127.0.0.1:59932)
0808 17:54:35.707537 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.707560 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.189:38071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260808 17:54:35.707659 30965 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.189:38071: Network error: Client connection negotiation failed: client connection to 127.28.213.189:38071: connect: Connection refused (error 111)
W20260808 17:54:35.752962 30978 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 17:54:35.753153 30978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:35.753177 30978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:35.753201 30978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:35.754312 30978 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:35.754354 30978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:35.754371 30978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:35.754387 30978 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:35.754411 30978 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:35.755839 30978 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:46707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:35713,127.28.213.189:38071,127.28.213.188:36705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.189.keytab
--principal=kudu/127.28.213.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.189:38071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.28.213.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:35.756062 30978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:35.756248 30978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:35.760520 30986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:35.760596 30988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:35.760568 30978 server_base.cc:1034] running on GCE node
W20260808 17:54:35.760536 30991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:35.760967 30978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:35.761210 30978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:35.762372 30978 hybrid_clock.cc:648] HybridClock initialized: now 1786211675762358 us; error 30 us; skew 500 ppm
Aug 08 17:54:35 dist-test-slave-bndk krb5kdc[30844](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211675, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:35.764575 30978 init.cc:377] Logged in from keytab as kudu/127.28.213.189@KRBTEST.COM (short username kudu)
I20260808 17:54:35.764989 30978 webserver.cc:460] Webserver started at http://127.28.213.189:41705/ using document root <none> and password file <none>
I20260808 17:54:35.765174 30978 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:35.765235 30978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:35.765359 30978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:35.766312 30978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-1/data/instance:
uuid: "1fc434af629d4e8b9468a0a5c7f21f1f"
format_stamp: "Formatted at 2026-08-08 17:54:35 on dist-test-slave-bndk"
server_key: "a8df795f092c9b6578e66c1d738e2ad1"
server_key_iv: "607ac8e9b1a24c34bf762c3cb505e966"
server_key_version: "encryptionkey@0"
I20260808 17:54:35.766625 30978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-1/wal/instance:
uuid: "1fc434af629d4e8b9468a0a5c7f21f1f"
format_stamp: "Formatted at 2026-08-08 17:54:35 on dist-test-slave-bndk"
server_key: "a8df795f092c9b6578e66c1d738e2ad1"
server_key_iv: "607ac8e9b1a24c34bf762c3cb505e966"
server_key_version: "encryptionkey@0"
I20260808 17:54:35.767822 30978 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 17:54:35.768442 31001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:35.768599 30978 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 17:54:35.768677 30978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-1/wal
uuid: "1fc434af629d4e8b9468a0a5c7f21f1f"
format_stamp: "Formatted at 2026-08-08 17:54:35 on dist-test-slave-bndk"
server_key: "a8df795f092c9b6578e66c1d738e2ad1"
server_key_iv: "607ac8e9b1a24c34bf762c3cb505e966"
server_key_version: "encryptionkey@0"
I20260808 17:54:35.768738 30978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:35.775794 30965 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } attempt: 2
I20260808 17:54:35.776142 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.776033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:38071 (local address 127.0.0.1:59942)
0808 17:54:35.776085 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.776115 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.189:38071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 17:54:35.776453 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.776364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:38071 (local address 127.0.0.1:59952)
0808 17:54:35.776403 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.776428 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.189:38071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260808 17:54:35.776546 30965 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.189:38071: Network error: Client connection negotiation failed: client connection to 127.28.213.189:38071: connect: Connection refused (error 111)
I20260808 17:54:35.777091 30978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:35.778688 30978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:35.778805 30978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:35.782449 30978 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.189:38071
I20260808 17:54:35.782478 31085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.189:38071 every 8 connection(s)
I20260808 17:54:35.782766 30978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-1/data/info.pb
I20260808 17:54:35.783515 31086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:35.784860 31086 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:54:35.787614 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 30978
I20260808 17:54:35.787698 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-1/wal/instance
I20260808 17:54:35.787846 29526 external_mini_cluster.cc:1428] Setting key 82f553752306b14f52cc463759a400fb
Aug 08 17:54:35 dist-test-slave-bndk krb5kdc[30844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211675, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.189@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:35.792783 30970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.785446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36544 (local address 127.28.213.190:35713)
0808 17:54:35.785500 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:35.785502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:35.785667 (+ 165us) server_negotiation.cc:407] Connection header received
0808 17:54:35.786069 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:35.786070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:35.786080 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:35.786129 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:35.786637 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.787096 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.788028 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.788272 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.788341 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:35.790172 (+ 1831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:35.790174 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:35.790174 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:35.790181 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:35.791363 (+ 1182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.791843 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.791844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.791845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.791904 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.792154 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.792155 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.792155 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.792247 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:35.792303 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:35.792614 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 17:54:35.792698 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:54:35.792907 31090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.785415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:35713 (local address 127.0.0.1:36544)
0808 17:54:35.785560 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.785597 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:35.785999 (+ 402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:35.786175 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:35.786178 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:35.786395 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:35.786578 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:35.786582 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.787152 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.787152 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:35.787956 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:35.787959 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.788341 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.788342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:35.788440 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:35.788832 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:35.788840 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:35.790090 (+ 1250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:35.791442 (+ 1352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:35.791451 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:35.791454 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:35.791777 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:35.791965 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:35.791966 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:35.791967 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:35.792098 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:35.792320 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:35.792326 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:35.792471 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 17:54:35.792565 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 17:54:35.792705 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":63,"threads_started":1}
I20260808 17:54:35.793401 31086 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.28.213.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.188@KRBTEST.COM" created.
Aug 08 17:54:35 dist-test-slave-bndk krb5kdc[30844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211675, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.189@KRBTEST.COM for kudu/127.28.213.189@KRBTEST.COM
I20260808 17:54:35.801929 31090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.793622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:38071 (local address 127.0.0.1:59960)
0808 17:54:35.793668 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.793679 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:35.793722 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:35.793927 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:35.793928 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:35.794062 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:35.794119 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:35.794120 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.794880 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.794881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:35.795624 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:35.795627 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.796216 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.796216 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:35.796259 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:35.796577 (+ 318us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:35.796580 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:35.799325 (+ 2745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:35.801025 (+ 1700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:35.801025 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:35.801026 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:35.801181 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:35.801419 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:35.801420 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:35.801420 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:35.801468 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:35.801733 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:35.801733 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:35.801764 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 17:54:35.801807 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 17:54:35.801868 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 17:54:35.802037 31093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.793662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59960 (local address 127.28.213.189:38071)
0808 17:54:35.793788 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:35.793792 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:35.793809 (+ 17us) server_negotiation.cc:407] Connection header received
0808 17:54:35.793829 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:35.793832 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:35.793843 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:35.793904 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:35.794182 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.794799 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.795756 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.796075 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.796158 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:35.799416 (+ 3258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:35.799423 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:35.799424 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:35.799429 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:35.800951 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.801287 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.801290 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.801291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.801349 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.801515 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.801516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.801516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.801677 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:35.801757 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:35.801847 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 17:54:35.801932 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":65,"threads_started":1}
I20260808 17:54:35.802525 31086 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:54:35.802804 31090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.802712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:36705 (local address 127.0.0.1:51806)
0808 17:54:35.802751 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.802787 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:36705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 17:54:35.802925 31002 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.213.188:36705: connect: Connection refused (error 111)
I20260808 17:54:35.803305 31090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.803226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:36705 (local address 127.0.0.1:51816)
0808 17:54:35.803266 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.803289 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:36705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 17:54:35.803395 31086 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.188:36705: Network error: Client connection negotiation failed: client connection to 127.28.213.188:36705: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.188.keytab.
Entry for principal kudu/127.28.213.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.188.keytab.
I20260808 17:54:35.812762 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.188:36705
--webserver_interface=127.28.213.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.188.keytab
--principal=kudu/127.28.213.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:46707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:35713,127.28.213.189:38071,127.28.213.188:36705
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:54:35.852586 31086 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } attempt: 1
I20260808 17:54:35.852983 31090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.852868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:36705 (local address 127.0.0.1:51820)
0808 17:54:35.852926 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.852955 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:36705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 17:54:35.853325 31090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.853198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:36705 (local address 127.0.0.1:51830)
0808 17:54:35.853255 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.853294 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:36705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 17:54:35.853452 31086 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.188:36705: Network error: Client connection negotiation failed: client connection to 127.28.213.188:36705: connect: Connection refused (error 111)
I20260808 17:54:35.867687 30965 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } attempt: 3
Aug 08 17:54:35 dist-test-slave-bndk krb5kdc[30844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211675, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for kudu/127.28.213.189@KRBTEST.COM
I20260808 17:54:35.873968 31093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.868014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59968 (local address 127.28.213.189:38071)
0808 17:54:35.868069 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:35.868071 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:35.868080 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:54:35.868136 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:35.868137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:35.868146 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:35.868190 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:35.868488 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.868966 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.869680 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.869894 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.869949 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:35.871672 (+ 1723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:35.871674 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:35.871674 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:35.871682 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:35.872972 (+ 1290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.873301 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.873302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.873302 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.873354 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.873518 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.873519 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.873519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.873620 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:35.873673 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:35.873811 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 17:54:35.873878 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:54:35.873980 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.867951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:38071 (local address 127.0.0.1:59968)
0808 17:54:35.868012 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.868022 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:35.868073 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:35.868200 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:35.868201 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:35.868353 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:35.868418 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:35.868420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.869038 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.869040 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:35.869597 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:35.869600 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.869954 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.869955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:35.870023 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:35.870401 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:35.870406 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:35.871594 (+ 1188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:35.873046 (+ 1452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:35.873047 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:35.873048 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:35.873209 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:35.873408 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:35.873409 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:35.873409 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:35.873468 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:35.873674 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:35.873675 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:35.873723 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 17:54:35.873782 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:54:35.873878 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 17:54:35.874460 30965 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:54:35.874789 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.874701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:36705 (local address 127.0.0.1:51838)
0808 17:54:35.874742 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.874770 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:36705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 17:54:35.875090 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.875021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:36705 (local address 127.0.0.1:51840)
0808 17:54:35.875055 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.875075 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:36705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 17:54:35.875171 30965 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.188:36705: Network error: Client connection negotiation failed: client connection to 127.28.213.188:36705: connect: Connection refused (error 111)
W20260808 17:54:35.891243 31097 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 17:54:35.891439 31097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:35.891455 31097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:35.891471 31097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:35.892598 31097 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:35.892638 31097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:35.892650 31097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:35.892663 31097 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:35.892673 31097 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:35.894124 31097 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:46707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:35713,127.28.213.189:38071,127.28.213.188:36705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.188.keytab
--principal=kudu/127.28.213.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.188:36705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.28.213.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:35.894304 31097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:35.894459 31097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:35.898818 31104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:35.898837 31110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:35.898856 31097 server_base.cc:1034] running on GCE node
W20260808 17:54:35.898831 31105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:35.899214 31097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:35.899475 31097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:35.900614 31097 hybrid_clock.cc:648] HybridClock initialized: now 1786211675900593 us; error 30 us; skew 500 ppm
Aug 08 17:54:35 dist-test-slave-bndk krb5kdc[30844](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211675, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:35.902828 31097 init.cc:377] Logged in from keytab as kudu/127.28.213.188@KRBTEST.COM (short username kudu)
I20260808 17:54:35.903239 31097 webserver.cc:460] Webserver started at http://127.28.213.188:35679/ using document root <none> and password file <none>
I20260808 17:54:35.903456 31097 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:35.903503 31097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:35.903627 31097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:35.904596 31097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-2/data/instance:
uuid: "b8b351e7f3f6401ca996fe3e4edb3c73"
format_stamp: "Formatted at 2026-08-08 17:54:35 on dist-test-slave-bndk"
server_key: "8455438c036cb279462f3d6ec88e1612"
server_key_iv: "7869f402dba3c8e6c7b7827a5883982b"
server_key_version: "encryptionkey@0"
I20260808 17:54:35.904918 31097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-2/wal/instance:
uuid: "b8b351e7f3f6401ca996fe3e4edb3c73"
format_stamp: "Formatted at 2026-08-08 17:54:35 on dist-test-slave-bndk"
server_key: "8455438c036cb279462f3d6ec88e1612"
server_key_iv: "7869f402dba3c8e6c7b7827a5883982b"
server_key_version: "encryptionkey@0"
I20260808 17:54:35.906153 31097 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 17:54:35.906345 30965 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } attempt: 1
I20260808 17:54:35.906673 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.906567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:36705 (local address 127.0.0.1:51846)
0808 17:54:35.906614 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.906643 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:36705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 17:54:35.906993 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.906913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:36705 (local address 127.0.0.1:51860)
0808 17:54:35.906951 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.906976 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:36705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 17:54:35.907079 30965 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.188:36705: Network error: Client connection negotiation failed: client connection to 127.28.213.188:36705: connect: Connection refused (error 111)
I20260808 17:54:35.907110 31122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:35.907244 31097 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 17:54:35.907325 31097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-2/wal
uuid: "b8b351e7f3f6401ca996fe3e4edb3c73"
format_stamp: "Formatted at 2026-08-08 17:54:35 on dist-test-slave-bndk"
server_key: "8455438c036cb279462f3d6ec88e1612"
server_key_iv: "7869f402dba3c8e6c7b7827a5883982b"
server_key_version: "encryptionkey@0"
I20260808 17:54:35.907397 31097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:35.921587 31086 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } attempt: 2
I20260808 17:54:35.921934 31090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.921832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:36705 (local address 127.0.0.1:51866)
0808 17:54:35.921882 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.921908 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:36705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 17:54:35.922260 31090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.922144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:36705 (local address 127.0.0.1:51870)
0808 17:54:35.922197 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.922232 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:36705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 17:54:35.922386 31086 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.188:36705: Network error: Client connection negotiation failed: client connection to 127.28.213.188:36705: connect: Connection refused (error 111)
I20260808 17:54:35.924849 31097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:35.926453 31097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:35.926573 31097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:35.930291 31097 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.188:36705
I20260808 17:54:35.930322 31198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.188:36705 every 8 connection(s)
I20260808 17:54:35.930640 31097 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-2/data/info.pb
I20260808 17:54:35.931461 31199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:35.932871 31199 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:54:35.936861 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 31097
I20260808 17:54:35.936949 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786211411189989-29526-0/minicluster-data/master-2/wal/instance
I20260808 17:54:35.937131 29526 external_mini_cluster.cc:1428] Setting key ae7f69a6294698536c051744e2a43c38
Aug 08 17:54:35 dist-test-slave-bndk krb5kdc[30844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211675, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.188@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:35.941401 30970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.933505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36556 (local address 127.28.213.190:35713)
0808 17:54:35.933555 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:35.933557 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:35.933736 (+ 179us) server_negotiation.cc:407] Connection header received
0808 17:54:35.934202 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:35.934203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:35.934216 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:35.934267 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:35.934849 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.935321 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.936228 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.936417 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.936473 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:35.938736 (+ 2263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:35.938737 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:35.938738 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:35.938746 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:35.940006 (+ 1260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.940421 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.940422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.940422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.940484 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.940734 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.940735 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.940735 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.940842 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:35.940896 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:35.941201 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 17:54:35.941307 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 17:54:35.941458 31201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.933470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:35713 (local address 127.0.0.1:36556)
0808 17:54:35.933630 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.933664 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:35.934112 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:35.934333 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:35.934338 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:35.934581 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:35.934762 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:35.934766 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.935403 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.935404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:35.936150 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:35.936152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.936484 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.936485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:35.936597 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:35.937056 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:35.937066 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:35.938656 (+ 1590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:35.940081 (+ 1425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:35.940088 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:35.940091 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:35.940358 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:35.940544 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:35.940545 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:35.940545 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:35.940670 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:35.940908 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:35.940916 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:35.941067 (+ 151us) client_negotiation.cc:769] Sending connection context
0808 17:54:35.941152 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 17:54:35.941299 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":75,"threads_started":1}
I20260808 17:54:35.942041 31199 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:54:35 dist-test-slave-bndk krb5kdc[30844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211675, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.188@KRBTEST.COM
I20260808 17:54:35.945623 31203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.937530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51882 (local address 127.28.213.188:36705)
0808 17:54:35.937675 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:35.937678 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:35.937769 (+ 91us) server_negotiation.cc:407] Connection header received
0808 17:54:35.937802 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:35.937804 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:35.937827 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:35.937908 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:35.938495 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.939399 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.940181 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.940520 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.940577 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:35.942989 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:35.942997 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:35.942997 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:35.943004 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:35.944501 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.944829 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.944832 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.944832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.944903 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.945085 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.945086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.945086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.945201 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:35.945381 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:35.945455 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 17:54:35.945528 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":73,"threads_started":1}
Aug 08 17:54:35 dist-test-slave-bndk krb5kdc[30844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211675, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.188@KRBTEST.COM for kudu/127.28.213.189@KRBTEST.COM
I20260808 17:54:35.948391 31093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.942340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59972 (local address 127.28.213.189:38071)
0808 17:54:35.942388 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:35.942391 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:35.942399 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:54:35.942423 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:35.942424 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:35.942433 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:35.942503 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:35.942728 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.943307 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.944082 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.944398 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.944472 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:35.946241 (+ 1769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:35.946242 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:35.946243 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:35.946250 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:35.947470 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.947755 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.947756 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.947757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.947807 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.947963 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.947964 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.947965 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.948063 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:35.948115 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:35.948242 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 17:54:35.948307 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:54:35.948390 31201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.942259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:38071 (local address 127.0.0.1:59972)
0808 17:54:35.942296 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.942307 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:35.942343 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:35.942505 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:35.942506 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:35.942614 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:35.942666 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:35.942667 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.943388 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.943389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:35.944006 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:35.944009 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.944466 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.944467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:35.944514 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:35.944827 (+ 313us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:35.944832 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:35.946171 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:35.947543 (+ 1372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:35.947544 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:35.947545 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:35.947696 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:35.947858 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:35.947859 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:35.947859 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:35.947913 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:35.948113 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:35.948114 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:35.948153 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 17:54:35.948214 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 17:54:35.948294 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 17:54:35.948662 31199 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:54:35 dist-test-slave-bndk krb5kdc[30844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211675, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
Aug 08 17:54:35 dist-test-slave-bndk krb5kdc[30844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211675, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.188@KRBTEST.COM for kudu/127.28.213.188@KRBTEST.COM
I20260808 17:54:35.952603 30970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.946327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36572 (local address 127.28.213.190:35713)
0808 17:54:35.946360 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:35.946362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:35.946369 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:54:35.946418 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:35.946418 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:35.946426 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:35.946471 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:35.946898 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.947330 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.947949 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.948141 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.948192 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:35.950380 (+ 2188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:35.950382 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:35.950382 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:35.950389 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:35.951614 (+ 1225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.951904 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.951905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.951905 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.951957 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.952112 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.952113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.952113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.952225 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:35.952406 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:35.952442 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 17:54:35.952513 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 17:54:35.954702 31201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.948869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:36705 (local address 127.0.0.1:51896)
0808 17:54:35.948908 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.948917 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:35.948950 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:35.949040 (+ 90us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:35.949041 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:35.949159 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:35.949180 (+ 21us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:35.949181 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.949949 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.949950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:35.950438 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:35.950440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.950868 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.950869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:35.950910 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:35.951309 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:35.951314 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:35.952317 (+ 1003us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:35.953874 (+ 1557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:35.953875 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:35.953875 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:35.954019 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:35.954174 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:35.954175 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:35.954175 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:35.954225 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:35.954426 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:35.954426 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:35.954462 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 17:54:35.954521 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:54:35.954608 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 17:54:35.954756 31203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.948925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51896 (local address 127.28.213.188:36705)
0808 17:54:35.948957 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:35.948958 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:35.948966 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:54:35.948992 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:35.948992 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:35.949000 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:35.949038 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:35.949259 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.949875 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.950509 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.950798 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.950876 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:35.952390 (+ 1514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:35.952391 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:35.952392 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:35.952398 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:35.953792 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.954076 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.954077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.954078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.954124 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.954273 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.954274 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.954274 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.954374 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:35.954426 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:35.954547 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 17:54:35.954654 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":18}
I20260808 17:54:35.956179 31199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73: Bootstrap starting.
Aug 08 17:54:35 dist-test-slave-bndk krb5kdc[30844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211675, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.189@KRBTEST.COM
I20260808 17:54:35.957144 31199 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:35.957520 31199 log.cc:824] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:35.958252 31199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73: No bootstrap required, opened a new log
I20260808 17:54:35.959563 31199 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } } peers { permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } } peers { permanent_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } }
I20260808 17:54:35.959682 31199 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8b351e7f3f6401ca996fe3e4edb3c73, State: Initialized, Role: FOLLOWER
I20260808 17:54:35.959717 31093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.953346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59986 (local address 127.28.213.189:38071)
0808 17:54:35.953390 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:35.953391 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:35.953427 (+ 36us) server_negotiation.cc:407] Connection header received
0808 17:54:35.953491 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:35.953492 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:35.953500 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:35.953543 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:35.953951 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.954372 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.955111 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.955310 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.955368 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:35.957500 (+ 2132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:35.957501 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:35.957501 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:35.957507 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:35.958770 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.959064 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.959065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.959065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.959117 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.959274 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.959275 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.959275 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.959381 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:35.959534 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:35.959569 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 17:54:35.959635 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:54:35.959758 31199 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } } peers { permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } } peers { permanent_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } }
I20260808 17:54:35.960168 31199 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:35.960136 31206 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } } peers { permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } } peers { permanent_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } } }
I20260808 17:54:35.960274 31206 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:54:35.961032 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:35.962313 30921 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "7c0e40c5d77c40ac9aaa2d5157028739"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36572
W20260808 17:54:35.961900 31222 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:54:35.963335 31222 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:54:35.962203 31097 master_runner.cc:186] Error getting master registration for 127.28.213.190:35713: OK, instance_id { permanent_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" instance_seqno: 1786211675643885 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 17:54:35.964524 31097 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 17:54:35.982223 30965 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } attempt: 2
Aug 08 17:54:35 dist-test-slave-bndk krb5kdc[30844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211675, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for kudu/127.28.213.188@KRBTEST.COM
I20260808 17:54:35.988765 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.982497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:36705 (local address 127.0.0.1:51898)
0808 17:54:35.982535 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:35.982561 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:35.982610 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:35.982738 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:35.982739 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:35.982896 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:35.982938 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:35.982939 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.983567 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.983568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:35.984046 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:35.984047 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.984365 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.984366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:35.984421 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:35.984810 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:35.984815 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:35.985970 (+ 1155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:35.987704 (+ 1734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:35.987705 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:35.987705 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:35.987926 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:35.988118 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:35.988118 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:35.988119 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:35.988176 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:35.988470 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:35.988471 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:35.988515 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 17:54:35.988576 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 17:54:35.988662 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260808 17:54:35.988778 31203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.982554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51898 (local address 127.28.213.188:36705)
0808 17:54:35.982625 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:35.982627 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:35.982653 (+ 26us) server_negotiation.cc:407] Connection header received
0808 17:54:35.982675 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:35.982675 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:35.982684 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:35.982729 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:35.983014 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.983495 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.984124 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:35.984307 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:35.984361 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:35.986057 (+ 1696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:35.986058 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:35.986059 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:35.986066 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:35.987617 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.987994 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.987995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.987995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.988056 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:35.988227 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:35.988228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:35.988228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:35.988409 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:35.988478 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:35.988612 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 17:54:35.988687 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 17:54:35.990523 30965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739: Bootstrap starting.
I20260808 17:54:35.991269 30965 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:35.991601 30965 log.cc:824] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:35.992467 30965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739: No bootstrap required, opened a new log
I20260808 17:54:35.993830 30965 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } } peers { permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } } peers { permanent_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } }
I20260808 17:54:35.993978 30965 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c0e40c5d77c40ac9aaa2d5157028739, State: Initialized, Role: FOLLOWER
I20260808 17:54:35.994072 30965 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } } peers { permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } } peers { permanent_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } }
I20260808 17:54:35.994396 30965 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:35.994431 30921 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 17:54:35.994539 30921 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:35.995527 30921 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } } peers { permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } } peers { permanent_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } }
W20260808 17:54:35.996268 31244 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:54:35.996388 31244 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:54:35.996397 31159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73"
I20260808 17:54:35.996527 31159 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:35.997437 31159 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c0e40c5d77c40ac9aaa2d5157028739 in term 1.
I20260808 17:54:35.997697 30885 leader_election.cc:302] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c0e40c5d77c40ac9aaa2d5157028739, b8b351e7f3f6401ca996fe3e4edb3c73; no voters:
I20260808 17:54:35.997918 30921 leader_election.cc:288] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [CANDIDATE]: Term 1 election: Requested vote from peers 1fc434af629d4e8b9468a0a5c7f21f1f (127.28.213.189:38071), b8b351e7f3f6401ca996fe3e4edb3c73 (127.28.213.188:36705)
I20260808 17:54:35.996922 30861 master_runner.cc:186] Error getting master registration for 127.28.213.189:38071: OK, instance_id { permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" instance_seqno: 1786211675781437 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 17:54:35.999609 30861 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 17:54:35.999688 31228 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } } peers { permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } } peers { permanent_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } } }
I20260808 17:54:35.999742 31228 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:54:35.999788 31228 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:35.999846 31228 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [term 1 LEADER]: Becoming Leader. State: Replica: 7c0e40c5d77c40ac9aaa2d5157028739, State: Running, Role: LEADER
I20260808 17:54:35.999920 31228 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } } peers { permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } } peers { permanent_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } }
I20260808 17:54:36.000512 31246 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c0e40c5d77c40ac9aaa2d5157028739. Latest consensus state: current_term: 1 leader_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } } peers { permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } } peers { permanent_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } } }
I20260808 17:54:36.000625 31246 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:36.000798 31260 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:36.000963 31260 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:36.002856 31159 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73 [term 1 FOLLOWER]: Refusing update from remote peer 7c0e40c5d77c40ac9aaa2d5157028739: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:54:36.003149 31228 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:54:36.004549 31206 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c0e40c5d77c40ac9aaa2d5157028739. Latest consensus state: current_term: 1 leader_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } } peers { permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } } peers { permanent_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } } }
I20260808 17:54:36.004642 31206 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:54:36.009529 30970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.999250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36578 (local address 127.28.213.190:35713)
0808 17:54:35.999303 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:35.999305 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:36.000536 (+ 1231us) server_negotiation.cc:407] Connection header received
0808 17:54:36.000688 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:36.000689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:36.000699 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:36.000743 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:36.002005 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:36.002741 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:36.004476 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:36.004794 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:36.004839 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:36.006541 (+ 1702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:36.006542 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:36.006542 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:36.006549 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:36.008183 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:36.008580 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:36.008581 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:36.008582 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:36.008636 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:36.008844 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:36.008845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:36.008845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:36.008974 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:36.009054 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:36.009352 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 17:54:36.009429 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 17:54:36.013516 31086 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } attempt: 3
I20260808 17:54:36.015547 31203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:36.000107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51904 (local address 127.28.213.188:36705)
0808 17:54:36.000143 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:36.000144 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:36.005563 (+ 5419us) server_negotiation.cc:407] Connection header received
0808 17:54:36.005680 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:36.005681 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:36.005691 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:36.005741 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:36.006778 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:36.007506 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:36.009166 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:36.009534 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:36.009573 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:36.011934 (+ 2361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:36.011935 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:36.011935 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:36.011951 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:36.013815 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:36.014431 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:36.014432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:36.014432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:36.014504 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:36.014819 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:36.014820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:36.014821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:36.014949 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:36.015015 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:36.015378 (+ 363us) server_negotiation.cc:299] Negotiation successful
0808 17:54:36.015457 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:54:36.015790 31093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:35.999686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59990 (local address 127.28.213.189:38071)
0808 17:54:35.999731 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:35.999733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:36.003442 (+ 3709us) server_negotiation.cc:407] Connection header received
0808 17:54:36.003555 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:36.003556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:36.003567 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:36.003596 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:36.009299 (+ 5703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:36.009988 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:36.011019 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:36.011336 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:36.011398 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:36.012714 (+ 1316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:36.012715 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:36.012715 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:36.012722 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:36.014456 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:36.014834 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:36.014835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:36.014836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:36.014891 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:36.015074 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:36.015074 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:36.015075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:36.015191 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:36.015252 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:36.015538 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 17:54:36.015650 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 17:54:36.018651 31228 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } } peers { permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } } peers { permanent_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } } }
I20260808 17:54:36.018745 31228 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:36.018936 31206 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } } peers { permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } } peers { permanent_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } } }
I20260808 17:54:36.019033 31206 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:54:36.019207 31265 mvcc.cc:205] Tried to move back new op lower bound from 7316323024905416704 to 7316323024896917504. Current Snapshot: MvccSnapshot[applied={T|T < 7316323024905416704}]
Aug 08 17:54:36 dist-test-slave-bndk krb5kdc[30844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211675, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.189@KRBTEST.COM for kudu/127.28.213.188@KRBTEST.COM
I20260808 17:54:36.020927 31260 catalog_manager.cc:1347] Generated new cluster ID: 204869ca07364b869d458b7e0e59789b
I20260808 17:54:36.020987 31260 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:36.023315 31090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:36.013753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:36705 (local address 127.0.0.1:51920)
0808 17:54:36.013876 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:36.013886 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:36.013924 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:36.015804 (+ 1880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:36.015806 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:36.015966 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:36.016007 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:36.016008 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:36.016892 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:36.016893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:36.017631 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:36.017635 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:36.018140 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:36.018141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:36.018216 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:36.019074 (+ 858us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:36.019079 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:36.020503 (+ 1424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:36.022266 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:36.022267 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:36.022268 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:36.022492 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:36.022698 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:36.022698 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:36.022699 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:36.022753 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:36.023005 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:36.023005 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:36.023045 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 17:54:36.023101 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 17:54:36.023190 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105}
I20260808 17:54:36.023701 31203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:36.014005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51920 (local address 127.28.213.188:36705)
0808 17:54:36.015609 (+ 1604us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:36.015611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:36.015618 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:54:36.015635 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:36.015635 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:36.015644 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:36.015693 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:36.016098 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:36.016786 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:36.017739 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:36.018012 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:36.018073 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:36.020590 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:36.020591 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:36.020592 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:36.020598 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:36.022150 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:36.022579 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:36.022580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:36.022580 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:36.022634 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:36.022811 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:36.022812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:36.022813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:36.022929 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:36.022981 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:36.023508 (+ 527us) server_negotiation.cc:299] Negotiation successful
0808 17:54:36.023580 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1592,"thread_start_us":82,"threads_started":1}
I20260808 17:54:36.024931 31086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f: Bootstrap starting.
I20260808 17:54:36.025804 31086 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:36.026098 31086 log.cc:824] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:36.026798 31086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f: No bootstrap required, opened a new log
I20260808 17:54:36.028133 31086 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } } peers { permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } } peers { permanent_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } }
I20260808 17:54:36.028239 31086 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fc434af629d4e8b9468a0a5c7f21f1f, State: Initialized, Role: FOLLOWER
I20260808 17:54:36.028316 31086 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } } peers { permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } } peers { permanent_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } }
I20260808 17:54:36.028556 31276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } } peers { permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } } peers { permanent_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } } }
I20260808 17:54:36.028628 31086 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:36.028687 31040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f"
I20260808 17:54:36.028824 31040 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f [term 0 FOLLOWER]: Advancing to term 1
W20260808 17:54:36.029371 31009 tablet.cc:2369] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:54:36.029749 31040 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c0e40c5d77c40ac9aaa2d5157028739 in term 1.
I20260808 17:54:36.030114 31038 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f [term 1 FOLLOWER]: Refusing update from remote peer 7c0e40c5d77c40ac9aaa2d5157028739: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:54:36.030521 31246 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:54:36.028698 31276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:54:36.033413 31276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c0e40c5d77c40ac9aaa2d5157028739. Latest consensus state: current_term: 1 leader_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } } peers { permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } } peers { permanent_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } } }
I20260808 17:54:36.033478 31276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:54:36.033512 31276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } } peers { permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } } peers { permanent_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } } }
I20260808 17:54:36.033555 31276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:54:36.036533 31297 mvcc.cc:205] Tried to move back new op lower bound from 7316323024905416704 to 7316323024896917504. Current Snapshot: MvccSnapshot[applied={T|T < 7316323024905416704}]
I20260808 17:54:36.037328 31246 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0e40c5d77c40ac9aaa2d5157028739" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 35713 } } peers { permanent_uuid: "1fc434af629d4e8b9468a0a5c7f21f1f" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 38071 } } peers { permanent_uuid: "b8b351e7f3f6401ca996fe3e4edb3c73" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 36705 } } }
I20260808 17:54:36.037416 31246 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739 [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:36.037603 31260 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:36.038293 31260 catalog_manager.cc:1504] Loading token signing keys...
I20260808 17:54:36.038920 31295 catalog_manager.cc:1259] Loaded cluster ID: 204869ca07364b869d458b7e0e59789b
I20260808 17:54:36.038980 31295 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f: loading cluster ID for follower catalog manager: success
I20260808 17:54:36.040112 31295 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f: acquiring CA information for follower catalog manager: success
W20260808 17:54:36.040222 31295 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260808 17:54:36.045002 31260 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c0e40c5d77c40ac9aaa2d5157028739: Generated new TSK 0
I20260808 17:54:36.045163 31260 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 17:54:36.068742 30970 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:36.067481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36594 (local address 127.28.213.190:35713)
0808 17:54:36.067523 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:36.067525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:36.068089 (+ 564us) server_negotiation.cc:407] Connection header received
0808 17:54:36.068189 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:36.068190 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:36.068200 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:36.068229 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:36.068670 (+ 441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36594: BlockingRecv error: recv got EOF from 127.0.0.1:36594 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 17:54:36.069756 31093 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:36.067819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60004 (local address 127.28.213.189:38071)
0808 17:54:36.067857 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:36.067859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:36.068976 (+ 1117us) server_negotiation.cc:407] Connection header received
0808 17:54:36.069353 (+ 377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:36.069354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:36.069364 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:36.069393 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:36.069699 (+ 306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60004: BlockingRecv error: recv got EOF from 127.0.0.1:60004 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 17:54:36.070554 31203 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:36.069133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51936 (local address 127.28.213.188:36705)
0808 17:54:36.069168 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:36.069170 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:36.069966 (+ 796us) server_negotiation.cc:407] Connection header received
0808 17:54:36.070120 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:36.070121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:36.070131 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:36.070158 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:36.070495 (+ 337us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51936: BlockingRecv error: recv got EOF from 127.0.0.1:51936 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 17:54:36.072757 31093 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:36.072068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60014 (local address 127.28.213.189:38071)
0808 17:54:36.072099 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:36.072100 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:36.072272 (+ 172us) server_negotiation.cc:407] Connection header received
0808 17:54:36.072368 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:36.072369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:36.072385 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:36.072411 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:36.072716 (+ 305us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60014: BlockingRecv error: recv got EOF from 127.0.0.1:60014 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 17:54:36.075616 31093 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:36.074894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60024 (local address 127.28.213.189:38071)
0808 17:54:36.074924 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:36.074925 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:36.075159 (+ 234us) server_negotiation.cc:407] Connection header received
0808 17:54:36.075245 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:36.075246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:36.075255 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:36.075280 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:36.075576 (+ 296us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60024: BlockingRecv error: recv got EOF from 127.0.0.1:60024 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 17:54:36.079248 31093 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:36.078563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60036 (local address 127.28.213.189:38071)
0808 17:54:36.078593 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:36.078595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:36.078809 (+ 214us) server_negotiation.cc:407] Connection header received
0808 17:54:36.078892 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:36.078893 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:36.078902 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:36.078928 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:36.079207 (+ 279us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60036: BlockingRecv error: recv got EOF from 127.0.0.1:60036 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260808 17:54:36.084972 31093 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:36.084193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60050 (local address 127.28.213.189:38071)
0808 17:54:36.084222 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:36.084224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:36.084434 (+ 210us) server_negotiation.cc:407] Connection header received
0808 17:54:36.084535 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:36.084536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:36.084544 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:36.084570 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:36.084932 (+ 362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60050: BlockingRecv error: recv got EOF from 127.0.0.1:60050 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260808 17:54:36.094841 31093 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:36.094010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60064 (local address 127.28.213.189:38071)
0808 17:54:36.094048 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:36.094050 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:36.094287 (+ 237us) server_negotiation.cc:407] Connection header received
0808 17:54:36.094394 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:36.094395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:36.094405 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:36.094433 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:36.094783 (+ 350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60064: BlockingRecv error: recv got EOF from 127.0.0.1:60064 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 17:54:36.112936 31093 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:36.112023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60072 (local address 127.28.213.189:38071)
0808 17:54:36.112065 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:36.112067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:36.112350 (+ 283us) server_negotiation.cc:407] Connection header received
0808 17:54:36.112451 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:36.112452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:36.112464 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:36.112501 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:36.112878 (+ 377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60072: BlockingRecv error: recv got EOF from 127.0.0.1:60072 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 17:54:36.147231 31093 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:36.146235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60074 (local address 127.28.213.189:38071)
0808 17:54:36.146281 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:36.146283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:36.146595 (+ 312us) server_negotiation.cc:407] Connection header received
0808 17:54:36.146701 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:36.146702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:36.146715 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:36.146746 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:36.147171 (+ 425us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60074: BlockingRecv error: recv got EOF from 127.0.0.1:60074 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 17:54:36.213039 31093 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:36.212434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60082 (local address 127.28.213.189:38071)
0808 17:54:36.212511 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:36.212512 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:36.212576 (+ 64us) server_negotiation.cc:407] Connection header received
0808 17:54:36.212627 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:36.212628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:36.212639 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:36.212690 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:36.212979 (+ 289us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60082: BlockingRecv error: recv got EOF from 127.0.0.1:60082 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260808 17:54:36.342797 31093 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:36.342090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60094 (local address 127.28.213.189:38071)
0808 17:54:36.342170 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:36.342172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:36.342242 (+ 70us) server_negotiation.cc:407] Connection header received
0808 17:54:36.342320 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:36.342321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:36.342334 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:36.342382 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:36.342734 (+ 352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60094: BlockingRecv error: recv got EOF from 127.0.0.1:60094 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 17:54:36.600373 31093 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:36.599803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60102 (local address 127.28.213.189:38071)
0808 17:54:36.599853 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:36.599854 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:36.599880 (+ 26us) server_negotiation.cc:407] Connection header received
0808 17:54:36.599949 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:36.599950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:36.599960 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:36.600019 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:36.600302 (+ 283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60102: BlockingRecv error: recv got EOF from 127.0.0.1:60102 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 17:54:36.963776 31222 catalog_manager.cc:1259] Loaded cluster ID: 204869ca07364b869d458b7e0e59789b
I20260808 17:54:36.963841 31222 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73: loading cluster ID for follower catalog manager: success
I20260808 17:54:36.964613 31222 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73: acquiring CA information for follower catalog manager: success
I20260808 17:54:36.964907 31222 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b8b351e7f3f6401ca996fe3e4edb3c73: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 17:54:37.040803 31295 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1fc434af629d4e8b9468a0a5c7f21f1f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 17:54:37.115912 31407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:37.113449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40656 (local address 127.28.213.189:38071)
0808 17:54:37.113565 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:37.113567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:37.113577 (+ 10us) server_negotiation.cc:407] Connection header received
0808 17:54:37.113656 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:37.113656 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:37.113707 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:37.113778 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:54:37.113929 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:37.114415 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:37.115156 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:37.115347 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:37.115405 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:37.115567 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:54:37.115677 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:54:37.115744 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:37.115794 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 17:54:37.115816 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":59,"threads_started":1}
I20260808 17:54:37.119597 31417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:37.117521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48468 (local address 127.28.213.188:36705)
0808 17:54:37.117609 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:37.117611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:37.117618 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:54:37.117654 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:37.117654 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:37.117689 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:37.117754 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:54:37.117821 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:37.118283 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:37.118943 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:37.119141 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:37.119206 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:37.119301 (+ 95us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:54:37.119406 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:54:37.119460 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:37.119479 (+ 19us) server_negotiation.cc:299] Negotiation successful
0808 17:54:37.119496 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72,"thread_start_us":45,"threads_started":1}
I20260808 17:54:37.123673 31407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:37.121147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40664 (local address 127.28.213.189:38071)
0808 17:54:37.121259 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:37.121260 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:37.121438 (+ 178us) server_negotiation.cc:407] Connection header received
0808 17:54:37.121470 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:37.121471 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:37.121481 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:37.121527 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:54:37.121640 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:37.122132 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:37.123064 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:37.123244 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:37.123298 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:37.123457 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:54:37.123489 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:54:37.123538 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:37.123586 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 17:54:37.123605 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 17:54:37.124070 31417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:37.121195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48476 (local address 127.28.213.188:36705)
0808 17:54:37.121250 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:37.121252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:37.121258 (+ 6us) server_negotiation.cc:407] Connection header received
0808 17:54:37.121279 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:37.121280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:37.121289 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:37.121339 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:54:37.121481 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:37.122211 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:37.123334 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:37.123565 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:37.123637 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:37.123845 (+ 208us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:54:37.123873 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:54:37.123897 (+ 24us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:37.123984 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 17:54:37.124006 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 17:54:37.124415 31431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:37.121045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41784 (local address 127.28.213.190:35713)
0808 17:54:37.121247 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:37.121250 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:37.121258 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:54:37.121300 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:37.121301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:37.121351 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:37.121442 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:54:37.121684 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:37.122425 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:37.123331 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:37.123604 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:37.123818 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:37.123902 (+ 84us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:54:37.124006 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:54:37.124288 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:37.124306 (+ 18us) server_negotiation.cc:299] Negotiation successful
0808 17:54:37.124332 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":47,"threads_started":1}
I20260808 17:54:37.125785 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 30861
I20260808 17:54:37.136530 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 30978
I20260808 17:54:37.145040 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 31097
2026-08-08T17:54:37Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2866 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 17:54:37 dist-test-slave-bndk krb5kdc[31438](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 17:54:37 dist-test-slave-bndk krb5kdc[31438](info): set up 2 sockets
Aug 08 17:54:37 dist-test-slave-bndk krb5kdc[31438](info): commencing operation
krb5kdc: starting...
W20260808 17:54:38.263229 29526 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/test-user.keytab.
Aug 08 17:54:38 dist-test-slave-bndk krb5kdc[31438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T17:54:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T17:54:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.213.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
Entry for principal kudu/127.28.213.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab.
I20260808 17:54:38.373770 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:44399
--webserver_interface=127.28.213.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:44559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:44399,127.28.213.189:33005,127.28.213.188:45327
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 17:54:38.452105 31457 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 17:54:38.452296 31457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:38.452312 31457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:38.452332 31457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:38.453475 31457 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:38.453512 31457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:38.453526 31457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:38.453548 31457 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:38.453572 31457 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:38.454994 31457 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:44559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:44399,127.28.213.189:33005,127.28.213.188:45327
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.190.keytab
--principal=kudu/127.28.213.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.190:44399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.213.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:38.455209 31457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:38.455408 31457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:38.459851 31463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:38.459846 31466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:38.459844 31464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:38.460104 31457 server_base.cc:1034] running on GCE node
I20260808 17:54:38.460315 31457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:38.460563 31457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:38.461694 31457 hybrid_clock.cc:648] HybridClock initialized: now 1786211678461682 us; error 28 us; skew 500 ppm
Aug 08 17:54:38 dist-test-slave-bndk krb5kdc[31438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211678, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:38.469318 31457 init.cc:377] Logged in from keytab as kudu/127.28.213.190@KRBTEST.COM (short username kudu)
I20260808 17:54:38.469704 31457 webserver.cc:460] Webserver started at http://127.28.213.190:46567/ using document root <none> and password file <none>
I20260808 17:54:38.469893 31457 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:38.469949 31457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:38.470072 31457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:38.471060 31457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-0/data/instance:
uuid: "3eeab065d52847289be625581093ef5a"
format_stamp: "Formatted at 2026-08-08 17:54:38 on dist-test-slave-bndk"
server_key: "c3427bbe2da2dbdf06e9006ee8563733"
server_key_iv: "8f64c969a46d8a97b9d7ac35504e404e"
server_key_version: "encryptionkey@0"
I20260808 17:54:38.471398 31457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-0/wal/instance:
uuid: "3eeab065d52847289be625581093ef5a"
format_stamp: "Formatted at 2026-08-08 17:54:38 on dist-test-slave-bndk"
server_key: "c3427bbe2da2dbdf06e9006ee8563733"
server_key_iv: "8f64c969a46d8a97b9d7ac35504e404e"
server_key_version: "encryptionkey@0"
I20260808 17:54:38.472591 31457 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 17:54:38.473269 31477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:38.473420 31457 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:38.473503 31457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-0/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-0/wal
uuid: "3eeab065d52847289be625581093ef5a"
format_stamp: "Formatted at 2026-08-08 17:54:38 on dist-test-slave-bndk"
server_key: "c3427bbe2da2dbdf06e9006ee8563733"
server_key_iv: "8f64c969a46d8a97b9d7ac35504e404e"
server_key_version: "encryptionkey@0"
I20260808 17:54:38.473567 31457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:38.491976 31457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:38.493965 31457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:38.494094 31457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:38.497889 31457 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.190:44399
I20260808 17:54:38.497923 31554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.190:44399 every 8 connection(s)
I20260808 17:54:38.498224 31457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-0/data/info.pb
I20260808 17:54:38.499051 31555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:38.500502 31555 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:54:38 dist-test-slave-bndk krb5kdc[31438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211678, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:38.507902 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 31457
I20260808 17:54:38.507980 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-0/wal/instance
I20260808 17:54:38.508144 29526 external_mini_cluster.cc:1428] Setting key e96851940788f1f52cc32a44c27c1d19
I20260808 17:54:38.508879 31559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.501094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44399 (local address 127.0.0.1:49304)
0808 17:54:38.501280 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.501320 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:38.501782 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:38.502047 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:38.502050 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:38.502290 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:38.502435 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:38.502440 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.503398 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.503399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:38.504045 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:38.504047 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.504484 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.504485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:38.504549 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.504915 (+ 366us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:38.504923 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:38.506186 (+ 1263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:38.507519 (+ 1333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:38.507525 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:38.507527 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:38.507697 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:38.507917 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:38.507917 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:38.507918 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:38.508013 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:38.508345 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:38.508350 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:38.508411 (+ 61us) client_negotiation.cc:769] Sending connection context
0808 17:54:38.508490 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 17:54:38.508707 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":90,"thread_start_us":76,"threads_started":1}
I20260808 17:54:38.508884 31561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.501139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49304 (local address 127.28.213.190:44399)
0808 17:54:38.501288 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.501297 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.501410 (+ 113us) server_negotiation.cc:407] Connection header received
0808 17:54:38.501936 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.501938 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.501955 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.502032 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.502523 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.503312 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.504119 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.504414 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.504505 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.506261 (+ 1756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:38.506267 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:38.506268 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:38.506274 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:38.507448 (+ 1174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.507782 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.507784 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.507784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.507858 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.508072 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.508073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.508073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.508285 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:38.508363 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:38.508529 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 17:54:38.508638 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":65,"threads_started":1}
I20260808 17:54:38.509946 31555 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:54:38.510241 31559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.510133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:33005 (local address 127.0.0.1:48578)
0808 17:54:38.510175 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.510220 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.189:33005: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 17:54:38.510370 31482 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.213.189:33005: connect: Connection refused (error 111)
I20260808 17:54:38.510782 31559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.510695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:33005 (local address 127.0.0.1:48592)
0808 17:54:38.510733 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.510761 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.189:33005: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 17:54:38.510878 31555 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.189:33005: Network error: Client connection negotiation failed: client connection to 127.28.213.189:33005: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.28.213.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.189.keytab.
Entry for principal kudu/127.28.213.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.189.keytab.
I20260808 17:54:38.530984 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.189:33005
--webserver_interface=127.28.213.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.189.keytab
--principal=kudu/127.28.213.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:44559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:44399,127.28.213.189:33005,127.28.213.188:45327
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:54:38.560097 31555 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } attempt: 1
I20260808 17:54:38.560585 31559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.560438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:33005 (local address 127.0.0.1:48596)
0808 17:54:38.560503 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.560547 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.189:33005: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 17:54:38.560927 31559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.560816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:33005 (local address 127.0.0.1:48602)
0808 17:54:38.560858 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.560905 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.189:33005: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 17:54:38.561030 31555 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.189:33005: Network error: Client connection negotiation failed: client connection to 127.28.213.189:33005: connect: Connection refused (error 111)
W20260808 17:54:38.609597 31565 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 17:54:38.609786 31565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:38.609802 31565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:38.609825 31565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:38.610934 31565 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:38.610971 31565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:38.610985 31565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:38.611007 31565 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:38.611032 31565 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:38.612465 31565 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:44559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:44399,127.28.213.189:33005,127.28.213.188:45327
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.189.keytab
--principal=kudu/127.28.213.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.189:33005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.28.213.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:38.612670 31565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:38.612877 31565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:38.617378 31578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:38.617403 31581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:38.617393 31588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:38.617638 31565 server_base.cc:1034] running on GCE node
I20260808 17:54:38.617856 31565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:38.618129 31565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:38.619266 31565 hybrid_clock.cc:648] HybridClock initialized: now 1786211678619250 us; error 28 us; skew 500 ppm
Aug 08 17:54:38 dist-test-slave-bndk krb5kdc[31438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211678, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:38.621567 31565 init.cc:377] Logged in from keytab as kudu/127.28.213.189@KRBTEST.COM (short username kudu)
I20260808 17:54:38.621976 31565 webserver.cc:460] Webserver started at http://127.28.213.189:44791/ using document root <none> and password file <none>
I20260808 17:54:38.622172 31565 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:38.622218 31565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:38.622344 31565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:38.623297 31565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-1/data/instance:
uuid: "6093279c41a84cbbb014dcc99b710690"
format_stamp: "Formatted at 2026-08-08 17:54:38 on dist-test-slave-bndk"
server_key: "08fbfb65355d5d18151dd3bc945f3655"
server_key_iv: "fa4c1f63a5a406b6d05757e38017a8eb"
server_key_version: "encryptionkey@0"
I20260808 17:54:38.623618 31565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-1/wal/instance:
uuid: "6093279c41a84cbbb014dcc99b710690"
format_stamp: "Formatted at 2026-08-08 17:54:38 on dist-test-slave-bndk"
server_key: "08fbfb65355d5d18151dd3bc945f3655"
server_key_iv: "fa4c1f63a5a406b6d05757e38017a8eb"
server_key_version: "encryptionkey@0"
I20260808 17:54:38.624783 31565 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:54:38.625466 31597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:38.625610 31565 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 17:54:38.625691 31565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-1/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-1/wal
uuid: "6093279c41a84cbbb014dcc99b710690"
format_stamp: "Formatted at 2026-08-08 17:54:38 on dist-test-slave-bndk"
server_key: "08fbfb65355d5d18151dd3bc945f3655"
server_key_iv: "fa4c1f63a5a406b6d05757e38017a8eb"
server_key_version: "encryptionkey@0"
I20260808 17:54:38.625747 31565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:38.629168 31555 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } attempt: 2
I20260808 17:54:38.629526 31559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.629394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:33005 (local address 127.0.0.1:48612)
0808 17:54:38.629454 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.629491 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.189:33005: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 17:54:38.629791 31559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.629727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:33005 (local address 127.0.0.1:48616)
0808 17:54:38.629757 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.629776 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.189:33005: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260808 17:54:38.629868 31555 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.189:33005: Network error: Client connection negotiation failed: client connection to 127.28.213.189:33005: connect: Connection refused (error 111)
I20260808 17:54:38.634003 31565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:38.635823 31565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:38.635950 31565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:38.639518 31565 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.189:33005
I20260808 17:54:38.639547 31673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.189:33005 every 8 connection(s)
I20260808 17:54:38.639834 31565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-1/data/info.pb
I20260808 17:54:38.640595 31674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:38.641968 31674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:54:38.644918 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 31565
I20260808 17:54:38.645001 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-1/wal/instance
I20260808 17:54:38.645169 29526 external_mini_cluster.cc:1428] Setting key 22d1d14f1f7777323f37f996be751c7f
Aug 08 17:54:38 dist-test-slave-bndk krb5kdc[31438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211678, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.189@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:38.649932 31561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.642520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49312 (local address 127.28.213.190:44399)
0808 17:54:38.642577 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.642579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.642748 (+ 169us) server_negotiation.cc:407] Connection header received
0808 17:54:38.643187 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.643188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.643202 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.643255 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.643818 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.644288 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.645272 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.645473 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.645529 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.647375 (+ 1846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:38.647376 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:38.647377 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:38.647385 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:38.648629 (+ 1244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.649004 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.649005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.649006 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.649075 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.649316 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.649317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.649317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.649455 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:38.649529 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:38.649741 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 17:54:38.649830 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 17:54:38.649943 31680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.642482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44399 (local address 127.0.0.1:49312)
0808 17:54:38.642640 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.642672 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:38.643097 (+ 425us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:38.643325 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:38.643328 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:38.643558 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:38.643730 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:38.643734 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.644367 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.644368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:38.645171 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:38.645173 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.645544 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.645544 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:38.645654 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.646049 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:38.646057 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:38.647289 (+ 1232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:38.648708 (+ 1419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:38.648716 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:38.648718 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:38.648922 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:38.649142 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:38.649142 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:38.649143 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:38.649269 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:38.649517 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:38.649521 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:38.649622 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 17:54:38.649695 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 17:54:38.649802 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":77,"threads_started":1}
I20260808 17:54:38.650471 31674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.28.213.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.213.188@KRBTEST.COM" created.
Aug 08 17:54:38 dist-test-slave-bndk krb5kdc[31438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211678, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.189@KRBTEST.COM for kudu/127.28.213.189@KRBTEST.COM
I20260808 17:54:38.659210 31680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.650680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:33005 (local address 127.0.0.1:48622)
0808 17:54:38.650726 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.650738 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:38.650780 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:38.650970 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:38.650971 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:38.651104 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:38.651158 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:38.651159 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.651930 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.651931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:38.652700 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:38.652703 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.653103 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.653104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:38.653176 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.653522 (+ 346us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:38.653527 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:38.656432 (+ 2905us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:38.658246 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:38.658247 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:38.658247 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:38.658440 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:38.658617 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:38.658618 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:38.658618 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:38.658684 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:38.658907 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:38.658908 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:38.658951 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 17:54:38.659022 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 17:54:38.659112 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 17:54:38.659240 31682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.650716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48622 (local address 127.28.213.189:33005)
0808 17:54:38.650844 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.650849 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.650865 (+ 16us) server_negotiation.cc:407] Connection header received
0808 17:54:38.650885 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.650886 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.650896 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.650955 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.651219 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.651856 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.652771 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.653039 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.653086 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.656503 (+ 3417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:38.656511 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:38.656511 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:38.656518 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:38.658171 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.658509 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.658511 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.658511 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.658564 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.658737 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.658737 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.658737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.658852 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:38.658914 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:38.659044 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 17:54:38.659158 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":103,"thread_start_us":70,"threads_started":1}
I20260808 17:54:38.659889 31674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:54:38.660167 31680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.660064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:45327 (local address 127.0.0.1:42668)
0808 17:54:38.660097 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.660144 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260808 17:54:38.660295 31600 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.213.188:45327: connect: Connection refused (error 111)
I20260808 17:54:38.660681 31680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.660588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:45327 (local address 127.0.0.1:42680)
0808 17:54:38.660630 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.660659 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 17:54:38.660779 31674 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.188:45327: Network error: Client connection negotiation failed: client connection to 127.28.213.188:45327: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.213.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.188.keytab.
Entry for principal kudu/127.28.213.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.188.keytab.
I20260808 17:54:38.669348 29526 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxAQlY3/build/release/bin/kudu
/tmp/dist-test-taskxAQlY3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.188:45327
--webserver_interface=127.28.213.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.188.keytab
--principal=kudu/127.28.213.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.213.148:44559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.213.190:44399,127.28.213.189:33005,127.28.213.188:45327
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 17:54:38.710011 31674 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } attempt: 1
I20260808 17:54:38.710465 31680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.710330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:45327 (local address 127.0.0.1:42696)
0808 17:54:38.710393 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.710433 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 17:54:38.710783 31680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.710703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:45327 (local address 127.0.0.1:42702)
0808 17:54:38.710738 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.710764 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 17:54:38.710871 31674 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.188:45327: Network error: Client connection negotiation failed: client connection to 127.28.213.188:45327: connect: Connection refused (error 111)
I20260808 17:54:38.720999 31555 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } attempt: 3
Aug 08 17:54:38 dist-test-slave-bndk krb5kdc[31438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211678, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for kudu/127.28.213.189@KRBTEST.COM
I20260808 17:54:38.728046 31559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.721320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:33005 (local address 127.0.0.1:48624)
0808 17:54:38.721379 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.721390 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:38.721453 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:38.721587 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:38.721588 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:38.721735 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:38.721806 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:38.721808 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.722729 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.722730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:38.723276 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:38.723278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.723755 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.723755 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:38.723804 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.724233 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:38.724237 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:38.725587 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:38.727186 (+ 1599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:38.727187 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:38.727187 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:38.727341 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:38.727523 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:38.727523 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:38.727524 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:38.727574 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:38.727788 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:38.727789 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:38.727826 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 17:54:38.727869 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 17:54:38.727982 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 17:54:38.728060 31682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.721371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48624 (local address 127.28.213.189:33005)
0808 17:54:38.721429 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.721431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.721443 (+ 12us) server_negotiation.cc:407] Connection header received
0808 17:54:38.721510 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.721510 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.721523 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.721581 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.721881 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.722645 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.723353 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.723691 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.723759 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.725666 (+ 1907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:38.725668 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:38.725668 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:38.725675 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:38.727109 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.727402 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.727403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.727403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.727464 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.727619 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.727620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.727620 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.727738 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:38.727794 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:38.727899 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 17:54:38.727971 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 17:54:38.728479 31555 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:54:38.728785 31559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.728677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:45327 (local address 127.0.0.1:42712)
0808 17:54:38.728721 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.728756 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 17:54:38.729130 31559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.729056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:45327 (local address 127.0.0.1:42728)
0808 17:54:38.729083 (+ 27us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.729109 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260808 17:54:38.729228 31555 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.188:45327: Network error: Client connection negotiation failed: client connection to 127.28.213.188:45327: connect: Connection refused (error 111)
W20260808 17:54:38.750165 31685 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 17:54:38.750345 31685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 17:54:38.750371 31685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 17:54:38.750406 31685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 17:54:38.751524 31685 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 17:54:38.751561 31685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 17:54:38.751574 31685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 17:54:38.751596 31685 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 17:54:38.751619 31685 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 17:54:38.753012 31685 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.213.148:44559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.28.213.190:44399,127.28.213.189:33005,127.28.213.188:45327
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/krb5kdc/kudu_127.28.213.188.keytab
--principal=kudu/127.28.213.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.213.188:45327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.28.213.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31685
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 16:03:43 UTC on ccycloud.quasar-rzkrkr.root.comops.site
build id 4574927
I20260808 17:54:38.753249 31685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 17:54:38.753463 31685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 17:54:38.757704 31691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 17:54:38.757728 31692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:38.757889 31685 server_base.cc:1034] running on GCE node
W20260808 17:54:38.757742 31694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 17:54:38.758126 31685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 17:54:38.758412 31685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 17:54:38.759555 31685 hybrid_clock.cc:648] HybridClock initialized: now 1786211678759536 us; error 34 us; skew 500 ppm
I20260808 17:54:38.760367 31555 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } attempt: 1
I20260808 17:54:38.760695 31559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.760571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:45327 (local address 127.0.0.1:42740)
0808 17:54:38.760626 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.760661 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 17:54:38.760987 31559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.760895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:45327 (local address 127.0.0.1:42748)
0808 17:54:38.760938 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.760964 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 17:54:38.761130 31555 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.188:45327: Network error: Client connection negotiation failed: client connection to 127.28.213.188:45327: connect: Connection refused (error 111)
Aug 08 17:54:38 dist-test-slave-bndk krb5kdc[31438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211678, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 17:54:38.762039 31685 init.cc:377] Logged in from keytab as kudu/127.28.213.188@KRBTEST.COM (short username kudu)
I20260808 17:54:38.762436 31685 webserver.cc:460] Webserver started at http://127.28.213.188:46299/ using document root <none> and password file <none>
I20260808 17:54:38.762601 31685 fs_manager.cc:359] Metadata directory not provided
I20260808 17:54:38.762638 31685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 17:54:38.762730 31685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 17:54:38.763648 31685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-2/data/instance:
uuid: "b8daccb3423b4fb1b58a466b99faba4b"
format_stamp: "Formatted at 2026-08-08 17:54:38 on dist-test-slave-bndk"
server_key: "a2dcc668db23a2a5890167ad2c0f0867"
server_key_iv: "87c9904eebb8b3746149a99b98db3d8e"
server_key_version: "encryptionkey@0"
I20260808 17:54:38.763926 31685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-2/wal/instance:
uuid: "b8daccb3423b4fb1b58a466b99faba4b"
format_stamp: "Formatted at 2026-08-08 17:54:38 on dist-test-slave-bndk"
server_key: "a2dcc668db23a2a5890167ad2c0f0867"
server_key_iv: "87c9904eebb8b3746149a99b98db3d8e"
server_key_version: "encryptionkey@0"
I20260808 17:54:38.765048 31685 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 17:54:38.765729 31704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:38.765872 31685 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 17:54:38.765957 31685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-2/data,/tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-2/wal
uuid: "b8daccb3423b4fb1b58a466b99faba4b"
format_stamp: "Formatted at 2026-08-08 17:54:38 on dist-test-slave-bndk"
server_key: "a2dcc668db23a2a5890167ad2c0f0867"
server_key_iv: "87c9904eebb8b3746149a99b98db3d8e"
server_key_version: "encryptionkey@0"
I20260808 17:54:38.766019 31685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 17:54:38.777009 31685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 17:54:38.778882 31685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 17:54:38.778982 31685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 17:54:38.779004 31674 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } attempt: 2
I20260808 17:54:38.779325 31680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.779209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:45327 (local address 127.0.0.1:42756)
0808 17:54:38.779253 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.779291 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260808 17:54:38.779637 31680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.779538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:45327 (local address 127.0.0.1:42770)
0808 17:54:38.779584 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.779615 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.213.188:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 17:54:38.779731 31674 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.213.188:45327: Network error: Client connection negotiation failed: client connection to 127.28.213.188:45327: connect: Connection refused (error 111)
I20260808 17:54:38.782740 31685 rpc_server.cc:307] RPC server started. Bound to: 127.28.213.188:45327
I20260808 17:54:38.782770 31783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.213.188:45327 every 8 connection(s)
I20260808 17:54:38.783048 31685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-2/data/info.pb
I20260808 17:54:38.783828 29526 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxAQlY3/build/release/bin/kudu as pid 31685
I20260808 17:54:38.783844 31784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 17:54:38.783936 29526 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxAQlY3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786211411189989-29526-0/minicluster-data/master-2/wal/instance
I20260808 17:54:38.784142 29526 external_mini_cluster.cc:1428] Setting key 88f6ec42f109888fa32b4d870625224d
I20260808 17:54:38.785964 31784 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:54:38 dist-test-slave-bndk krb5kdc[31438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.188@KRBTEST.COM
Aug 08 17:54:38 dist-test-slave-bndk krb5kdc[31438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211678, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.188@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:38.793553 31561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.786580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49322 (local address 127.28.213.190:44399)
0808 17:54:38.786621 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.786623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.786757 (+ 134us) server_negotiation.cc:407] Connection header received
0808 17:54:38.786815 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.786816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.786827 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.786874 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.787298 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.787731 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.788531 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.788705 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.788756 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.791070 (+ 2314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:38.791072 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:38.791072 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:38.791078 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:38.792448 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.792825 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.792826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.792826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.792875 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.793038 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.793039 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.793039 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.793139 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:38.793197 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:38.793401 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 17:54:38.793473 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 17:54:38.793645 31790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.786543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.190:44399 (local address 127.0.0.1:49322)
0808 17:54:38.786671 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.786704 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:38.786761 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:38.786896 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:38.786899 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:38.787143 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:38.787218 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:38.787221 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.787807 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.787808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:38.788456 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:38.788459 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.788781 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.788782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:38.788838 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.789198 (+ 360us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:38.789206 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:38.790995 (+ 1789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:38.792512 (+ 1517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:38.792518 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:38.792520 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:38.792762 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:38.792925 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:38.792926 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:38.792926 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:38.792984 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:38.793197 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:38.793203 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:38.793281 (+ 78us) client_negotiation.cc:769] Sending connection context
0808 17:54:38.793364 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 17:54:38.793491 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":33,"thread_start_us":73,"threads_started":1}
I20260808 17:54:38.793645 31787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.784607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42776 (local address 127.28.213.188:45327)
0808 17:54:38.784747 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.784755 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.784780 (+ 25us) server_negotiation.cc:407] Connection header received
0808 17:54:38.785189 (+ 409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.785195 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.785266 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.785381 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.786116 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.787136 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.787890 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.788264 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.788334 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.790541 (+ 2207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:38.790548 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:38.790548 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:38.790555 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:38.792140 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.792497 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.792500 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.792500 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.792615 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.792784 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.792785 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.792786 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.793060 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:38.793156 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:38.793304 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 17:54:38.793435 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":56,"threads_started":1}
I20260808 17:54:38.794289 31784 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 17:54:38 dist-test-slave-bndk krb5kdc[31438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211678, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.188@KRBTEST.COM for kudu/127.28.213.189@KRBTEST.COM
Aug 08 17:54:38 dist-test-slave-bndk krb5kdc[31438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.190@KRBTEST.COM
I20260808 17:54:38.800655 31682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.794557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48638 (local address 127.28.213.189:33005)
0808 17:54:38.794593 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.794595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.794602 (+ 7us) server_negotiation.cc:407] Connection header received
0808 17:54:38.794623 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.794624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.794633 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.794687 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.794894 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.795489 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.796209 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.796495 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.796562 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.798301 (+ 1739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:38.798302 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:38.798303 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:38.798310 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:38.799758 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.800048 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.800049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.800049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.800104 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.800239 (+ 135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.800239 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.800240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.800357 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:38.800428 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:38.800542 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 17:54:38.800600 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:54:38.800674 31790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.794495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.189:33005 (local address 127.0.0.1:48638)
0808 17:54:38.794531 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.794540 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:38.794570 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:38.794690 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:38.794691 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:38.794789 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:38.794828 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:38.794829 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.795549 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.795550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:38.796142 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:38.796144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.796560 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.796561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:38.796619 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.796924 (+ 305us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:38.796928 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:38.798212 (+ 1284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:38.799831 (+ 1619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:38.799832 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:38.799832 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:38.799985 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:38.800166 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:38.800166 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:38.800166 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:38.800205 (+ 39us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:38.800414 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:38.800415 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:38.800453 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 17:54:38.800516 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 17:54:38.800592 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 17:54:38.800945 31784 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } has no permanent_uuid. Determining permanent_uuid...
I20260808 17:54:38.801590 31561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.794512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49338 (local address 127.28.213.190:44399)
0808 17:54:38.794727 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.794728 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.794733 (+ 5us) server_negotiation.cc:407] Connection header received
0808 17:54:38.794746 (+ 13us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.794746 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.794752 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.794790 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.795295 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.795840 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.796579 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.796821 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.796884 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.799098 (+ 2214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:38.799099 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:38.799099 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:38.799106 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:38.800363 (+ 1257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.800697 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.800698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.800698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.800756 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.800981 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.800982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.800982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.801095 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:38.801256 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:38.801445 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 17:54:38.801510 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200}
Aug 08 17:54:38 dist-test-slave-bndk krb5kdc[31438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211678, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.188@KRBTEST.COM for kudu/127.28.213.188@KRBTEST.COM
Aug 08 17:54:38 dist-test-slave-bndk krb5kdc[31438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.213.189@KRBTEST.COM
I20260808 17:54:38.806780 31790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.801133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:45327 (local address 127.0.0.1:42790)
0808 17:54:38.801171 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.801180 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:38.801212 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:38.801337 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:38.801337 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:38.801452 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:38.801473 (+ 21us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:38.801474 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.802191 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.802192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:38.802703 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:38.802705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.803023 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.803024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:38.803072 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.803405 (+ 333us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:38.803409 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:38.804544 (+ 1135us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:38.805868 (+ 1324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:38.805869 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:38.805869 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:38.806052 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:38.806210 (+ 158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:38.806211 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:38.806211 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:38.806262 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:38.806502 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:38.806503 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:38.806537 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 17:54:38.806596 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:54:38.806683 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260808 17:54:38.806830 31787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.801195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42790 (local address 127.28.213.188:45327)
0808 17:54:38.801256 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.801257 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.801274 (+ 17us) server_negotiation.cc:407] Connection header received
0808 17:54:38.801289 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.801290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.801297 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.801336 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.801530 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.802119 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.802776 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.802966 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.803013 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.804619 (+ 1606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:38.804620 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:38.804620 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:38.804626 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:38.805799 (+ 1173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.806111 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.806112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.806112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.806161 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.806326 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.806327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.806327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.806435 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:38.806501 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:38.806629 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 17:54:38.806732 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":48}
I20260808 17:54:38.808693 31682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.802131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48648 (local address 127.28.213.189:33005)
0808 17:54:38.802170 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.802171 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.802179 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:54:38.802217 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.802218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.802227 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.802280 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.802656 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.803183 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.803822 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.804110 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.804178 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.806258 (+ 2080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:38.806260 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:38.806260 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:38.806266 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:38.807790 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.808122 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.808123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.808123 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.808168 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.808317 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.808318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.808318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.808397 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:38.808521 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:38.808585 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 17:54:38.808641 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 17:54:38.808854 31784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b: Bootstrap starting.
I20260808 17:54:38.809710 31784 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:38.810012 31784 log.cc:824] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:38.810536 29526 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 17:54:38.810760 31784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b: No bootstrap required, opened a new log
I20260808 17:54:38.811517 31520 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "3eeab065d52847289be625581093ef5a"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49338
I20260808 17:54:38.812451 31784 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeab065d52847289be625581093ef5a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } } peers { permanent_uuid: "6093279c41a84cbbb014dcc99b710690" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } } peers { permanent_uuid: "b8daccb3423b4fb1b58a466b99faba4b" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } }
I20260808 17:54:38.812595 31784 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8daccb3423b4fb1b58a466b99faba4b, State: Initialized, Role: FOLLOWER
I20260808 17:54:38.812680 31784 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeab065d52847289be625581093ef5a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } } peers { permanent_uuid: "6093279c41a84cbbb014dcc99b710690" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } } peers { permanent_uuid: "b8daccb3423b4fb1b58a466b99faba4b" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } }
I20260808 17:54:38.812922 31792 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeab065d52847289be625581093ef5a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } } peers { permanent_uuid: "6093279c41a84cbbb014dcc99b710690" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } } peers { permanent_uuid: "b8daccb3423b4fb1b58a466b99faba4b" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } } }
I20260808 17:54:38.812979 31784 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:38.813004 31792 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b [sys.catalog]: This master's current role is: FOLLOWER
W20260808 17:54:38.814679 31808 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:54:38.814733 31808 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:54:38.814996 31685 master_runner.cc:186] Error getting master registration for 127.28.213.190:44399: OK, instance_id { permanent_uuid: "3eeab065d52847289be625581093ef5a" instance_seqno: 1786211678496765 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 17:54:38.817049 31685 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 17:54:38.836207 31555 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } attempt: 2
Aug 08 17:54:38 dist-test-slave-bndk krb5kdc[31438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211678, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.190@KRBTEST.COM for kudu/127.28.213.188@KRBTEST.COM
I20260808 17:54:38.842129 31559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.836450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:45327 (local address 127.0.0.1:42802)
0808 17:54:38.836494 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.836504 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:38.836543 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:38.836652 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:38.836653 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:38.836798 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:38.836833 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:38.836835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.837441 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.837442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:38.837936 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:38.837937 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.838241 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.838242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:38.838295 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.838722 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:38.838726 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:38.839910 (+ 1184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:38.841243 (+ 1333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:38.841244 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:38.841244 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:38.841405 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:38.841568 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:38.841569 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:38.841569 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:38.841624 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:38.841848 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:38.841849 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:38.841893 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 17:54:38.841951 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 17:54:38.842040 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 17:54:38.842126 31787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.836501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42802 (local address 127.28.213.188:45327)
0808 17:54:38.836556 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.836558 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.836567 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:54:38.836585 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.836586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.836595 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.836641 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.836903 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.837370 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.838010 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.838184 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.838236 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.839983 (+ 1747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:38.839985 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:38.839985 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:38.839992 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:38.841152 (+ 1160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.841465 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.841467 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.841467 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.841514 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.841674 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.841674 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.841675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.841789 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:38.841844 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:38.841981 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 17:54:38.842043 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 17:54:38.843458 31555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a: Bootstrap starting.
I20260808 17:54:38.844024 31555 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:38.844272 31555 log.cc:824] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:38.844923 31555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a: No bootstrap required, opened a new log
I20260808 17:54:38.845902 31555 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeab065d52847289be625581093ef5a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } } peers { permanent_uuid: "6093279c41a84cbbb014dcc99b710690" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } } peers { permanent_uuid: "b8daccb3423b4fb1b58a466b99faba4b" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } }
I20260808 17:54:38.846005 31555 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeab065d52847289be625581093ef5a, State: Initialized, Role: FOLLOWER
I20260808 17:54:38.846081 31555 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeab065d52847289be625581093ef5a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } } peers { permanent_uuid: "6093279c41a84cbbb014dcc99b710690" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } } peers { permanent_uuid: "b8daccb3423b4fb1b58a466b99faba4b" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } }
I20260808 17:54:38.846313 31811 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeab065d52847289be625581093ef5a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } } peers { permanent_uuid: "6093279c41a84cbbb014dcc99b710690" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } } peers { permanent_uuid: "b8daccb3423b4fb1b58a466b99faba4b" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } } }
I20260808 17:54:38.846364 31555 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:38.846410 31811 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:54:38.846493 31520 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 17:54:38.846601 31520 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:38.847378 31520 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeab065d52847289be625581093ef5a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } } peers { permanent_uuid: "6093279c41a84cbbb014dcc99b710690" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } } peers { permanent_uuid: "b8daccb3423b4fb1b58a466b99faba4b" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } }
I20260808 17:54:38.848259 31746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eeab065d52847289be625581093ef5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b8daccb3423b4fb1b58a466b99faba4b"
I20260808 17:54:38.848364 31746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b [term 0 FOLLOWER]: Advancing to term 1
W20260808 17:54:38.848445 31823 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:54:38.848492 31823 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:54:38.849162 31746 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeab065d52847289be625581093ef5a in term 1.
I20260808 17:54:38.849418 31482 leader_election.cc:302] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeab065d52847289be625581093ef5a, b8daccb3423b4fb1b58a466b99faba4b; no voters:
I20260808 17:54:38.849467 31520 leader_election.cc:288] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [CANDIDATE]: Term 1 election: Requested vote from peers 6093279c41a84cbbb014dcc99b710690 (127.28.213.189:33005), b8daccb3423b4fb1b58a466b99faba4b (127.28.213.188:45327)
I20260808 17:54:38.849574 31811 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 17:54:38.849711 31811 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [term 1 LEADER]: Becoming Leader. State: Replica: 3eeab065d52847289be625581093ef5a, State: Running, Role: LEADER
I20260808 17:54:38.849797 31811 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeab065d52847289be625581093ef5a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } } peers { permanent_uuid: "6093279c41a84cbbb014dcc99b710690" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } } peers { permanent_uuid: "b8daccb3423b4fb1b58a466b99faba4b" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } }
I20260808 17:54:38.850476 31826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3eeab065d52847289be625581093ef5a. Latest consensus state: current_term: 1 leader_uuid: "3eeab065d52847289be625581093ef5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeab065d52847289be625581093ef5a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } } peers { permanent_uuid: "6093279c41a84cbbb014dcc99b710690" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } } peers { permanent_uuid: "b8daccb3423b4fb1b58a466b99faba4b" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } } }
I20260808 17:54:38.850554 31826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:38.852012 31838 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 17:54:38.852193 31838 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 17:54:38.850600 31457 master_runner.cc:186] Error getting master registration for 127.28.213.189:33005: OK, instance_id { permanent_uuid: "6093279c41a84cbbb014dcc99b710690" instance_seqno: 1786211678638525 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 17:54:38.852746 31457 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 17:54:38.855504 31746 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b [term 1 FOLLOWER]: Refusing update from remote peer 3eeab065d52847289be625581093ef5a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:54:38.855818 31811 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8daccb3423b4fb1b58a466b99faba4b" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:54:38.857358 31792 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3eeab065d52847289be625581093ef5a. Latest consensus state: current_term: 1 leader_uuid: "3eeab065d52847289be625581093ef5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeab065d52847289be625581093ef5a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } } peers { permanent_uuid: "6093279c41a84cbbb014dcc99b710690" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } } peers { permanent_uuid: "b8daccb3423b4fb1b58a466b99faba4b" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } } }
I20260808 17:54:38.857446 31792 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:54:38.864656 31561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.851236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49350 (local address 127.28.213.190:44399)
0808 17:54:38.851288 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.851290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.852586 (+ 1296us) server_negotiation.cc:407] Connection header received
0808 17:54:38.852677 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.852678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.852688 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.852724 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.853494 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.854125 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.855982 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.856263 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.856302 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.858678 (+ 2376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:38.858680 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:38.858680 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:38.858687 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:38.860614 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.861721 (+ 1107us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.861735 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.861735 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.861790 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.863412 (+ 1622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.863413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.863413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.863538 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:38.863631 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:38.864505 (+ 874us) server_negotiation.cc:299] Negotiation successful
0808 17:54:38.864576 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 17:54:38.864786 31682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.851574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48652 (local address 127.28.213.189:33005)
0808 17:54:38.851610 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.851612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.853881 (+ 2269us) server_negotiation.cc:407] Connection header received
0808 17:54:38.854177 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.854178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.854201 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.854229 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.857572 (+ 3343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.858258 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.859645 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.859949 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.859984 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.861458 (+ 1474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:38.861459 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:38.861459 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:38.861466 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:38.862987 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.863996 (+ 1009us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.863997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.863998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.864054 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.864267 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.864268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.864268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.864385 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:38.864456 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:38.864636 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 17:54:38.864707 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:54:38.866374 31826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3eeab065d52847289be625581093ef5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeab065d52847289be625581093ef5a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } } peers { permanent_uuid: "6093279c41a84cbbb014dcc99b710690" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } } peers { permanent_uuid: "b8daccb3423b4fb1b58a466b99faba4b" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } } }
I20260808 17:54:38.866451 31826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:38.866494 31787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.851840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42812 (local address 127.28.213.188:45327)
0808 17:54:38.851879 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.851881 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.853796 (+ 1915us) server_negotiation.cc:407] Connection header received
0808 17:54:38.854295 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.854296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.854317 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.854344 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.856335 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.856964 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.859630 (+ 2666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.859905 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.859959 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.862882 (+ 2923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:38.862883 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:38.862884 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:38.862902 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:38.864356 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.865667 (+ 1311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.865668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.865668 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.865722 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.865968 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.865969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.865970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.866089 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:38.866161 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:38.866350 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 17:54:38.866420 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 17:54:38.866515 31792 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3eeab065d52847289be625581093ef5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeab065d52847289be625581093ef5a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } } peers { permanent_uuid: "6093279c41a84cbbb014dcc99b710690" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } } peers { permanent_uuid: "b8daccb3423b4fb1b58a466b99faba4b" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } } }
I20260808 17:54:38.866587 31792 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:54:38.866632 31842 mvcc.cc:205] Tried to move back new op lower bound from 7316323036589486080 to 7316323036569395200. Current Snapshot: MvccSnapshot[applied={T|T < 7316323036589486080}]
I20260808 17:54:38.867015 31843 mvcc.cc:205] Tried to move back new op lower bound from 7316323036589486080 to 7316323036569395200. Current Snapshot: MvccSnapshot[applied={T|T < 7316323036589486080}]
I20260808 17:54:38.867475 31838 catalog_manager.cc:1347] Generated new cluster ID: d55c0514ab32483c987aa2442c2b314c
I20260808 17:54:38.867523 31838 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 17:54:38.870833 31674 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } attempt: 3
Aug 08 17:54:38 dist-test-slave-bndk krb5kdc[31438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786211678, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.213.189@KRBTEST.COM for kudu/127.28.213.188@KRBTEST.COM
I20260808 17:54:38.877741 31680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.871046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.213.188:45327 (local address 127.0.0.1:42824)
0808 17:54:38.871087 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 17:54:38.871096 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 17:54:38.871129 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 17:54:38.871236 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 17:54:38.871237 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 17:54:38.871409 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 17:54:38.871446 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:38.871447 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.872232 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.872233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:38.872998 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 17:54:38.872999 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.873441 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.873442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 17:54:38.873488 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.873846 (+ 358us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 17:54:38.873850 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 17:54:38.875194 (+ 1344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 17:54:38.876724 (+ 1530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:38.876725 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:38.876725 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:38.876935 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:38.877118 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 17:54:38.877119 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 17:54:38.877119 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 17:54:38.877175 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 17:54:38.877473 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 17:54:38.877474 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 17:54:38.877515 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 17:54:38.877574 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 17:54:38.877659 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 17:54:38.878057 31787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:38.871090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42824 (local address 127.28.213.188:45327)
0808 17:54:38.871135 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.871137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.871145 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:54:38.871186 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.871187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.871195 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.871234 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.871523 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.872181 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.873071 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:38.873382 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:38.873431 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:38.875265 (+ 1834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 17:54:38.875267 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 17:54:38.875267 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 17:54:38.875273 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 17:54:38.876664 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.877007 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.877008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.877008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.877058 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 17:54:38.877263 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 17:54:38.877264 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 17:54:38.877264 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 17:54:38.877392 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 17:54:38.877447 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:38.877907 (+ 460us) server_negotiation.cc:299] Negotiation successful
0808 17:54:38.877974 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 17:54:38.879431 31674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690: Bootstrap starting.
I20260808 17:54:38.880064 31674 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690: Neither blocks nor log segments found. Creating new log.
I20260808 17:54:38.880311 31674 log.cc:824] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690: Log is configured to *not* fsync() on all Append() calls
I20260808 17:54:38.881253 31674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690: No bootstrap required, opened a new log
I20260808 17:54:38.882813 31674 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeab065d52847289be625581093ef5a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } } peers { permanent_uuid: "6093279c41a84cbbb014dcc99b710690" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } } peers { permanent_uuid: "b8daccb3423b4fb1b58a466b99faba4b" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } }
I20260808 17:54:38.882923 31674 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6093279c41a84cbbb014dcc99b710690, State: Initialized, Role: FOLLOWER
I20260808 17:54:38.882974 31674 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeab065d52847289be625581093ef5a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } } peers { permanent_uuid: "6093279c41a84cbbb014dcc99b710690" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } } peers { permanent_uuid: "b8daccb3423b4fb1b58a466b99faba4b" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } }
I20260808 17:54:38.883193 31850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeab065d52847289be625581093ef5a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } } peers { permanent_uuid: "6093279c41a84cbbb014dcc99b710690" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } } peers { permanent_uuid: "b8daccb3423b4fb1b58a466b99faba4b" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } } }
I20260808 17:54:38.883234 31674 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 17:54:38.883288 31641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eeab065d52847289be625581093ef5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6093279c41a84cbbb014dcc99b710690"
I20260808 17:54:38.883358 31641 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690 [term 0 FOLLOWER]: Advancing to term 1
I20260808 17:54:38.884182 31641 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeab065d52847289be625581093ef5a in term 1.
I20260808 17:54:38.884388 31640 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690 [term 1 FOLLOWER]: Refusing update from remote peer 3eeab065d52847289be625581093ef5a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 17:54:38.884418 31850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:54:38.884918 31811 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6093279c41a84cbbb014dcc99b710690" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 17:54:38.885357 31838 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 17:54:38.886004 31838 catalog_manager.cc:1504] Loading token signing keys...
W20260808 17:54:38.886698 31606 tablet.cc:2369] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 17:54:38.887760 31872 mvcc.cc:205] Tried to move back new op lower bound from 7316323036589486080 to 7316323036569395200. Current Snapshot: MvccSnapshot[applied={T|T < 7316323036589486080}]
I20260808 17:54:38.887913 31874 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3eeab065d52847289be625581093ef5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeab065d52847289be625581093ef5a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } } peers { permanent_uuid: "6093279c41a84cbbb014dcc99b710690" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } } peers { permanent_uuid: "b8daccb3423b4fb1b58a466b99faba4b" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } } }
I20260808 17:54:38.888017 31874 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 17:54:38.888460 31869 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 17:54:38.888541 31869 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 17:54:38.887364 31850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3eeab065d52847289be625581093ef5a. Latest consensus state: current_term: 1 leader_uuid: "3eeab065d52847289be625581093ef5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeab065d52847289be625581093ef5a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } } peers { permanent_uuid: "6093279c41a84cbbb014dcc99b710690" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } } peers { permanent_uuid: "b8daccb3423b4fb1b58a466b99faba4b" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } } }
I20260808 17:54:38.889235 31850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 17:54:38.889207 31826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3eeab065d52847289be625581093ef5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeab065d52847289be625581093ef5a" member_type: VOTER last_known_addr { host: "127.28.213.190" port: 44399 } } peers { permanent_uuid: "6093279c41a84cbbb014dcc99b710690" member_type: VOTER last_known_addr { host: "127.28.213.189" port: 33005 } } peers { permanent_uuid: "b8daccb3423b4fb1b58a466b99faba4b" member_type: VOTER last_known_addr { host: "127.28.213.188" port: 45327 } } }
I20260808 17:54:38.889330 31826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a [sys.catalog]: This master's current role is: LEADER
I20260808 17:54:38.890190 31838 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3eeab065d52847289be625581093ef5a: Generated new TSK 0
I20260808 17:54:38.890340 31838 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 17:54:38.921983 31561 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:38.920538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49360 (local address 127.28.213.190:44399)
0808 17:54:38.920580 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.920582 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.921334 (+ 752us) server_negotiation.cc:407] Connection header received
0808 17:54:38.921446 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.921447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.921458 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.921486 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.921905 (+ 419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49360: BlockingRecv error: recv got EOF from 127.0.0.1:49360 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 17:54:38.922710 31682 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:38.920861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48658 (local address 127.28.213.189:33005)
0808 17:54:38.920899 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.920901 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.922213 (+ 1312us) server_negotiation.cc:407] Connection header received
0808 17:54:38.922302 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.922303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.922314 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.922340 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.922644 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48658: BlockingRecv error: recv got EOF from 127.0.0.1:48658 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 17:54:38.923502 31787 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:38.921138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42832 (local address 127.28.213.188:45327)
0808 17:54:38.921177 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.921178 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.922919 (+ 1741us) server_negotiation.cc:407] Connection header received
0808 17:54:38.923008 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.923009 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.923019 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.923046 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.923440 (+ 394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42832: BlockingRecv error: recv got EOF from 127.0.0.1:42832 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 17:54:38.925256 31682 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:38.924562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48660 (local address 127.28.213.189:33005)
0808 17:54:38.924593 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.924595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.924780 (+ 185us) server_negotiation.cc:407] Connection header received
0808 17:54:38.924877 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.924878 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.924894 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.924920 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.925194 (+ 274us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48660: BlockingRecv error: recv got EOF from 127.0.0.1:48660 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260808 17:54:38.928109 31682 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:38.927330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48674 (local address 127.28.213.189:33005)
0808 17:54:38.927369 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.927370 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.927607 (+ 237us) server_negotiation.cc:407] Connection header received
0808 17:54:38.927691 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.927691 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.927700 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.927726 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.928071 (+ 345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48674: BlockingRecv error: recv got EOF from 127.0.0.1:48674 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260808 17:54:38.931725 31682 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:38.931022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48680 (local address 127.28.213.189:33005)
0808 17:54:38.931051 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.931052 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.931257 (+ 205us) server_negotiation.cc:407] Connection header received
0808 17:54:38.931374 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.931375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.931384 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.931410 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.931687 (+ 277us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48680: BlockingRecv error: recv got EOF from 127.0.0.1:48680 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260808 17:54:38.937382 31682 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:38.936662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48688 (local address 127.28.213.189:33005)
0808 17:54:38.936693 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.936694 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.936909 (+ 215us) server_negotiation.cc:407] Connection header received
0808 17:54:38.936994 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.936995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.937003 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.937029 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.937330 (+ 301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48688: BlockingRecv error: recv got EOF from 127.0.0.1:48688 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 17:54:38.947125 31682 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:38.946377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48694 (local address 127.28.213.189:33005)
0808 17:54:38.946431 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.946433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.946685 (+ 252us) server_negotiation.cc:407] Connection header received
0808 17:54:38.946767 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.946768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.946777 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.946803 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.947085 (+ 282us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48694: BlockingRecv error: recv got EOF from 127.0.0.1:48694 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260808 17:54:38.965013 31682 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:38.964198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48696 (local address 127.28.213.189:33005)
0808 17:54:38.964232 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.964234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.964499 (+ 265us) server_negotiation.cc:407] Connection header received
0808 17:54:38.964595 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.964596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.964607 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.964634 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.964968 (+ 334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48696: BlockingRecv error: recv got EOF from 127.0.0.1:48696 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 17:54:38.999284 31682 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:38.998545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48706 (local address 127.28.213.189:33005)
0808 17:54:38.998590 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:38.998592 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:38.998688 (+ 96us) server_negotiation.cc:407] Connection header received
0808 17:54:38.998747 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:38.998748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:38.998760 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:38.998837 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:38.999222 (+ 385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48706: BlockingRecv error: recv got EOF from 127.0.0.1:48706 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 17:54:39.064895 31682 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:39.064278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48710 (local address 127.28.213.189:33005)
0808 17:54:39.064335 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:39.064337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:39.064434 (+ 97us) server_negotiation.cc:407] Connection header received
0808 17:54:39.064502 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:39.064503 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:39.064513 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:39.064551 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:39.064832 (+ 281us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48710: BlockingRecv error: recv got EOF from 127.0.0.1:48710 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260808 17:54:39.195952 31682 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:39.195187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48714 (local address 127.28.213.189:33005)
0808 17:54:39.195232 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:39.195234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:39.195371 (+ 137us) server_negotiation.cc:407] Connection header received
0808 17:54:39.195457 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:39.195458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:39.195470 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:39.195533 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:39.195891 (+ 358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48714: BlockingRecv error: recv got EOF from 127.0.0.1:48714 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 17:54:39.453672 31682 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 17:54:39.453039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48724 (local address 127.28.213.189:33005)
0808 17:54:39.453099 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:39.453101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:39.453109 (+ 8us) server_negotiation.cc:407] Connection header received
0808 17:54:39.453190 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:39.453191 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:39.453203 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:39.453262 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 17:54:39.453609 (+ 347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48724: BlockingRecv error: recv got EOF from 127.0.0.1:48724 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 17:54:39.815147 31808 catalog_manager.cc:1259] Loaded cluster ID: d55c0514ab32483c987aa2442c2b314c
I20260808 17:54:39.815217 31808 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b: loading cluster ID for follower catalog manager: success
I20260808 17:54:39.816015 31808 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b: acquiring CA information for follower catalog manager: success
I20260808 17:54:39.816305 31808 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b8daccb3423b4fb1b58a466b99faba4b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 17:54:39.889020 31869 catalog_manager.cc:1259] Loaded cluster ID: d55c0514ab32483c987aa2442c2b314c
I20260808 17:54:39.889098 31869 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690: loading cluster ID for follower catalog manager: success
I20260808 17:54:39.889961 31869 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690: acquiring CA information for follower catalog manager: success
I20260808 17:54:39.890293 31869 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6093279c41a84cbbb014dcc99b710690: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 17:54:39.969239 31976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:39.966694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48738 (local address 127.28.213.189:33005)
0808 17:54:39.966805 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:39.966808 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:39.966901 (+ 93us) server_negotiation.cc:407] Connection header received
0808 17:54:39.966971 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:39.966972 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:39.967025 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:39.967097 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:54:39.967238 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:39.967807 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:39.968581 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:39.968770 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:39.968816 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:39.968926 (+ 110us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:54:39.969036 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:54:39.969094 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:39.969112 (+ 18us) server_negotiation.cc:299] Negotiation successful
0808 17:54:39.969129 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":59,"threads_started":1}
I20260808 17:54:39.973111 31983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:39.970850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42846 (local address 127.28.213.188:45327)
0808 17:54:39.970958 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:39.970960 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:39.970984 (+ 24us) server_negotiation.cc:407] Connection header received
0808 17:54:39.971027 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:39.971028 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:39.971071 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:39.971134 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:54:39.971233 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:39.971716 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:39.972397 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:39.972609 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:39.972661 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:39.972801 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:54:39.972904 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:54:39.972969 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:39.973011 (+ 42us) server_negotiation.cc:299] Negotiation successful
0808 17:54:39.973032 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":53,"threads_started":1}
I20260808 17:54:39.977270 31983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:39.974942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42852 (local address 127.28.213.188:45327)
0808 17:54:39.974981 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:39.974983 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:39.975159 (+ 176us) server_negotiation.cc:407] Connection header received
0808 17:54:39.975216 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:39.975217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:39.975225 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:39.975266 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:54:39.975340 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:39.975818 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:39.976523 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:39.976794 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:39.976848 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:39.977006 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:54:39.977035 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:54:39.977079 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:39.977167 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 17:54:39.977185 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 17:54:39.977320 31976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:39.974687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48752 (local address 127.28.213.189:33005)
0808 17:54:39.974739 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:39.974742 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:39.974854 (+ 112us) server_negotiation.cc:407] Connection header received
0808 17:54:39.974936 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:39.974936 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:39.974945 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:39.974989 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:54:39.975127 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:39.975835 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:39.976613 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:39.976814 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:39.976869 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:39.977050 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:54:39.977083 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:54:39.977123 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:39.977236 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 17:54:39.977257 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 17:54:39.978240 31999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 17:54:39.974541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49364 (local address 127.28.213.190:44399)
0808 17:54:39.974642 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 17:54:39.974645 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 17:54:39.974654 (+ 9us) server_negotiation.cc:407] Connection header received
0808 17:54:39.974697 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 17:54:39.974698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 17:54:39.974746 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 17:54:39.974831 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 17:54:39.974970 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:39.975769 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:39.977439 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 17:54:39.977724 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 17:54:39.977782 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 17:54:39.978001 (+ 219us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 17:54:39.978076 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 17:54:39.978120 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 17:54:39.978146 (+ 26us) server_negotiation.cc:299] Negotiation successful
0808 17:54:39.978164 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":48,"threads_started":1}
I20260808 17:54:39.979775 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 31457
I20260808 17:54:39.996176 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 31565
I20260808 17:54:40.006078 29526 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxAQlY3/build/release/bin/kudu with pid 31685
2026-08-08T17:54:40Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2861 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5728 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (268824 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST